Jun 10 20:41:56.903507 ip-10-0-142-242 systemd[1]: Starting Kubernetes Kubelet... Jun 10 20:41:57.295208 ip-10-0-142-242 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:57.295208 ip-10-0-142-242 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 20:41:57.295208 ip-10-0-142-242 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:57.295208 ip-10-0-142-242 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 20:41:57.295208 ip-10-0-142-242 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 20:41:57.295859 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.295311 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 20:41:57.299739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299724 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.299739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299739 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.299739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299742 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299745 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299750 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299753 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299758 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299761 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299764 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299767 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299771 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299775 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299778 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299781 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299785 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299789 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299792 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299798 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299802 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299805 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.299845 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299808 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299811 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299814 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299816 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299819 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299822 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299824 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299827 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299830 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299832 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299835 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299837 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299840 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299842 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299845 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299847 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299851 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299853 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299856 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299859 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.300318 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299861 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299864 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299867 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299869 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299871 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299874 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299877 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299879 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299882 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299884 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299887 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299889 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299892 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299894 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299897 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299900 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299902 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299905 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299907 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299910 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.300819 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299913 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299915 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299917 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299920 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299922 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299926 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299928 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299931 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299933 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299936 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299939 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299941 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299944 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299946 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299949 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299951 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299954 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299956 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299959 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299962 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.301319 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299964 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299967 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299969 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299971 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299974 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299976 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299980 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299983 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299986 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299988 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299991 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299993 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299996 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.299998 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300000 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300003 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300006 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300008 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300011 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300700 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.301790 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300706 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300708 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300711 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300714 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300716 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300719 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300722 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300725 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300728 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300730 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300733 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300735 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300739 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300741 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300744 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300747 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300749 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300752 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300758 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.302525 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300760 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300762 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300765 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300768 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300770 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300772 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300775 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300780 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300783 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300786 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300789 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300792 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300795 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300797 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300800 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300802 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300805 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300807 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300810 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.304375 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300812 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300815 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300818 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300821 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300823 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300826 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300829 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300832 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300834 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300837 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300839 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300842 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300844 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300847 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300851 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300854 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300857 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300860 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300862 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300865 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.305187 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300867 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300870 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300872 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300874 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300877 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300879 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300882 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300884 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300887 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300889 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300891 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300894 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300896 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300899 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300902 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300912 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300914 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300917 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300920 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300923 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.305741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300925 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300928 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300932 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300936 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300939 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300942 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300944 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300947 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300950 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300953 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300956 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300958 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300961 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300963 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300965 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300968 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300970 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300973 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.300975 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.306368 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301334 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301339 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301342 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301344 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301347 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301350 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301355 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301357 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301360 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301363 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301365 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301368 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301371 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301374 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301376 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301381 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301383 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301386 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301388 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301391 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.307031 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301394 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301396 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301398 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301401 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301403 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301406 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301410 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301413 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301416 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301418 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301420 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301423 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301425 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301428 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301430 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301434 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301438 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301441 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301445 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301448 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.307552 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301450 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301455 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301458 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301461 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301464 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301467 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301470 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301474 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301477 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301479 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301482 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301485 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301487 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301490 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301493 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301495 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301498 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301501 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301503 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.308120 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301506 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301509 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301511 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301513 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301516 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301519 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301522 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301524 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301527 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301529 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301532 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301536 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301538 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301541 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301543 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301546 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301549 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301551 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301553 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.308662 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301556 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301560 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301564 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301566 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301569 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301572 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301574 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301577 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301579 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301582 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301584 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301587 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301589 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301591 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301594 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301596 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301598 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301601 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301603 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301605 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.309126 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.301608 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303760 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303789 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303801 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303807 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303813 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303819 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303826 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303833 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303838 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303843 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303848 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303853 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303858 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303863 2578 flags.go:64] FLAG: --cgroup-root="" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303868 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303873 2578 flags.go:64] FLAG: --client-ca-file="" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303878 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303882 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303890 2578 flags.go:64] FLAG: --cluster-domain="" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303895 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303900 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303907 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303912 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 20:41:57.309634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303918 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303923 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303928 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303933 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303938 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303943 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303947 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303952 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303956 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303963 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303969 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303974 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303978 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303983 2578 flags.go:64] FLAG: --enable-server="true" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303988 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303995 2578 flags.go:64] FLAG: --event-burst="100" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.303999 2578 flags.go:64] FLAG: --event-qps="50" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304004 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304009 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304014 2578 flags.go:64] FLAG: --eviction-hard="" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304030 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304036 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304041 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304045 2578 flags.go:64] FLAG: --eviction-soft="" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304050 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 20:41:57.310199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304055 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304059 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304066 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304070 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304075 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304080 2578 flags.go:64] FLAG: --feature-gates="" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304086 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304090 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304095 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304100 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304105 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304110 2578 flags.go:64] FLAG: --help="false" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304114 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304120 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304125 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304129 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304135 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304141 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304146 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304150 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304155 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304159 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304164 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304169 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 20:41:57.310834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304174 2578 flags.go:64] FLAG: --kube-reserved="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304178 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304183 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304188 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304192 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304197 2578 flags.go:64] FLAG: --lock-file="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304202 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304206 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304211 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304220 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304224 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304230 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304256 2578 flags.go:64] FLAG: --logging-format="text" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304261 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304266 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304271 2578 flags.go:64] FLAG: --manifest-url="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304276 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304283 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304288 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304298 2578 flags.go:64] FLAG: --max-pods="110" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304304 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304309 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304313 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304318 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304322 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 20:41:57.311543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304327 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304332 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304344 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304349 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304354 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304359 2578 flags.go:64] FLAG: --pod-cidr="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304363 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304372 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304376 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304381 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304386 2578 flags.go:64] FLAG: --port="10250" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304390 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304395 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cb956cb28697404d" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304400 2578 flags.go:64] FLAG: --qos-reserved="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304405 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304410 2578 flags.go:64] FLAG: --register-node="true" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304415 2578 flags.go:64] FLAG: --register-with-taints="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304420 2578 flags.go:64] FLAG: --registry-burst="10" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304425 2578 flags.go:64] FLAG: --registry-qps="5" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304430 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304435 2578 flags.go:64] FLAG: --reserved-memory="" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304441 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304445 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304450 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304455 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 20:41:57.312170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304460 2578 flags.go:64] FLAG: --runonce="false" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304464 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304470 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304475 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304479 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304484 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304488 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304493 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304515 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304521 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304526 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304530 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304535 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304540 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304545 2578 flags.go:64] FLAG: --system-cgroups="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304549 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304559 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304564 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304568 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304576 2578 flags.go:64] FLAG: --tls-min-version="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304580 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304585 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304589 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304594 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304599 2578 flags.go:64] FLAG: --v="2" Jun 10 20:41:57.312831 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304605 2578 flags.go:64] FLAG: --version="false" Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304611 2578 flags.go:64] FLAG: --vmodule="" Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304618 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.304623 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304796 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304803 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304808 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304813 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304817 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304821 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304826 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304830 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304834 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304839 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304846 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304850 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304854 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304858 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304862 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304867 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.313450 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304871 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304875 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304879 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304883 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304887 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304891 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304895 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304899 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304904 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304910 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304916 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304921 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304925 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304930 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304935 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304940 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304944 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304949 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304953 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304957 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.313981 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304961 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304965 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304970 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304974 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304978 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304982 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304987 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304991 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.304996 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305000 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305004 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305009 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305013 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305017 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305021 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305025 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305029 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305033 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305038 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305042 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.314513 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305046 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305050 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305054 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305059 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305063 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305067 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305071 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305075 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305080 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305084 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305088 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305092 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305096 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305100 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305105 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305108 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305112 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305117 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305126 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305130 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.315095 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305134 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305138 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305143 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305146 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305151 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305155 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305159 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305163 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305167 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305171 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305176 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305180 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305184 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305189 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305195 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305201 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305205 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305209 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305215 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.315672 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305230 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305235 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305255 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.305260 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.305900 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.312510 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.312524 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.312543 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.312549 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312598 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312603 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312606 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312609 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312612 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.316138 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312615 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312618 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312620 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312623 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312625 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312628 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312631 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312634 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312636 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312639 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312641 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312644 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312647 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312649 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312652 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312654 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312657 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312659 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312662 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.316510 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312664 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312667 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312669 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312671 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312674 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312678 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312681 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312683 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312686 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312688 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312691 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312695 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312698 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312701 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312704 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312706 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312709 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312711 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312714 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.316985 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312716 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312719 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312721 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312724 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312726 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312729 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312731 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312734 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312736 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312738 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312741 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312743 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312746 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312748 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312751 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312753 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312756 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312759 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312761 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312764 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.317478 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312767 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312769 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312772 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312774 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312777 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312779 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312782 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312785 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312787 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312790 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312792 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312795 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312797 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312799 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312803 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312807 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312810 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312812 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312815 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312817 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.317969 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312820 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312822 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312825 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312828 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312832 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312835 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312838 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312841 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312844 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312847 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312850 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312852 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312855 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312858 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312860 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.318485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312863 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.312867 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312976 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312980 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312983 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312986 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312988 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312991 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312994 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312996 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.312999 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313001 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313003 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313006 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313008 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 20:41:57.318852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313011 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313013 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313016 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313018 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313021 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313023 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313025 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313028 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313030 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313032 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313035 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313037 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313040 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313043 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313045 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313048 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313051 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313053 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313056 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 20:41:57.319233 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313059 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313062 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313066 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313069 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313074 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313077 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313079 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313082 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313084 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313086 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313089 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313091 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313094 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313096 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313099 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313101 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313103 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313106 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 20:41:57.319739 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313108 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313110 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313113 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313115 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313118 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313120 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313123 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313126 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313128 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313131 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313134 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313137 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313139 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313142 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313144 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313146 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313149 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313151 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313154 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313156 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 20:41:57.320217 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313158 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313161 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313163 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313172 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313176 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313180 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313183 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313186 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313189 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313192 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313195 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313198 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313201 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313203 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313206 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313209 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313211 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313216 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313219 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313231 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 20:41:57.320741 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313234 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313237 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313252 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313256 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313259 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313261 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313264 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:57.313266 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.313271 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.313357 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.316947 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.318329 2578 server.go:1019] "Starting client certificate rotation" Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.318420 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:41:57.321260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.318448 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 20:41:57.321596 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.320833 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:41:57.321955 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.321935 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 20:41:57.331972 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.331956 2578 log.go:25] "Validated CRI v1 runtime API" Jun 10 20:41:57.335701 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.335684 2578 log.go:25] "Validated CRI v1 image API" Jun 10 20:41:57.336485 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.336460 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 20:41:57.339833 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.339816 2578 fs.go:135] Filesystem UUIDs: map[3ea507e8-9ff9-4fc8-b403-6c6efb0474f4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8989de56-384f-4e49-99c0-9e2283335016:/dev/nvme0n1p3] Jun 10 20:41:57.339912 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.339833 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 20:41:57.344652 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.344543 2578 manager.go:216] Machine: {Timestamp:2026-06-10 20:41:57.343301054 +0000 UTC m=+0.324010505 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101049 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec232d7c50873ac09eb25c47da520199 SystemUUID:ec232d7c-5087-3ac0-9eb2-5c47da520199 BootID:1b553c43-5776-4322-8e8f-b4833073917f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:54:47:f7:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:54:47:f7:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:ca:0a:31:44:11 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 20:41:57.344652 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.344645 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 20:41:57.344788 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.344714 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 20:41:57.348214 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.348192 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 20:41:57.348382 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.348216 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 20:41:57.348641 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.348626 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:41:57.349034 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.349023 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 20:41:57.349092 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.349042 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 20:41:57.349092 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.349052 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:41:57.349784 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.349773 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 20:41:57.350736 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.350724 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 20:41:57.354196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354183 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:41:57.354332 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354321 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 20:41:57.354387 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354359 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 10 20:41:57.354387 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354373 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 20:41:57.354481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354393 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 20:41:57.354481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354406 2578 kubelet.go:398] "Adding apiserver pod source" Jun 10 20:41:57.354481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354419 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 20:41:57.354761 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354747 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:41:57.354819 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.354769 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 20:41:57.357058 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.357041 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 20:41:57.359081 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.359068 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 20:41:57.359138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.359097 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 20:41:57.361574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361563 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361579 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361585 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361591 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361599 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361604 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361612 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361616 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361624 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 20:41:57.361625 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361629 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 20:41:57.361884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361645 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 20:41:57.361884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.361650 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 20:41:57.362791 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.362770 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 20:41:57.362892 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.362876 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 20:41:57.363162 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.363153 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 20:41:57.363195 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.363163 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 20:41:57.365759 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.365745 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 20:41:57.366870 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.366857 2578 server.go:1268] "Started kubelet" Jun 10 20:41:57.366997 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.366924 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 20:41:57.367999 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.367922 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 20:41:57.368094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.368022 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 20:41:57.369149 ip-10-0-142-242 systemd[1]: Started Kubernetes Kubelet. Jun 10 20:41:57.370198 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.369931 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 20:41:57.371507 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.371481 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qqdp" Jun 10 20:41:57.371628 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.371612 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 10 20:41:57.375975 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.375954 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 20:41:57.376258 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376229 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 20:41:57.376322 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376303 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 20:41:57.376372 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.376330 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.376881 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376865 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 20:41:57.376985 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376873 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 20:41:57.376985 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376939 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 20:41:57.377123 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.376996 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 10 20:41:57.377123 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377008 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 10 20:41:57.377207 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.376112 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-242.ec2.internal.18b7d2f2ac87e38d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-242.ec2.internal,UID:ip-10-0-142-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-242.ec2.internal,},FirstTimestamp:2026-06-10 20:41:57.366825869 +0000 UTC m=+0.347535322,LastTimestamp:2026-06-10 20:41:57.366825869 +0000 UTC m=+0.347535322,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-242.ec2.internal,}" Jun 10 20:41:57.377207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377183 2578 factory.go:55] Registering systemd factory Jun 10 20:41:57.377207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377196 2578 factory.go:223] Registration of the systemd container factory successfully Jun 10 20:41:57.377472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377459 2578 factory.go:153] Registering CRI-O factory Jun 10 20:41:57.377472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377473 2578 factory.go:223] Registration of the crio container factory successfully Jun 10 20:41:57.377574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377513 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 20:41:57.377574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377535 2578 factory.go:103] Registering Raw factory Jun 10 20:41:57.377574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377545 2578 manager.go:1196] Started watching for new ooms in manager Jun 10 20:41:57.377884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377867 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9qqdp" Jun 10 20:41:57.377944 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.377885 2578 manager.go:349] Starting recovery of all containers Jun 10 20:41:57.385875 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.385853 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:57.388225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.388210 2578 manager.go:354] Recovery completed Jun 10 20:41:57.389255 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.389225 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.389725 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.389704 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 20:41:57.393109 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.393095 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.394975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.394960 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.395043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.394986 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.395043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.394998 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.395538 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.395526 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 20:41:57.395538 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.395538 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 20:41:57.395629 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.395554 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 10 20:41:57.395629 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.395560 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.396219 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.396204 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.396271 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.396237 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.396303 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.396279 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.397148 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.397137 2578 policy_none.go:49] "None policy: Start" Jun 10 20:41:57.397184 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.397153 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 20:41:57.397184 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.397165 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 20:41:57.398852 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.398840 2578 policy_none.go:47] "Start" Jun 10 20:41:57.438766 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.438751 2578 manager.go:337] "Starting Device Plugin manager" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.438780 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.438788 2578 server.go:87] "Starting device plugin registration server" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.438997 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.439009 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.439101 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.439193 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.439202 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.439844 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.439906 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.447433 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.448551 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.448595 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.448615 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.448684 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 20:41:57.453472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.451128 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:57.539467 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.539439 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.540336 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.540319 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.540444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.540348 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.540444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.540357 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.540444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.540379 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.549207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.549156 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal"] Jun 10 20:41:57.549207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.549206 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.549439 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.549423 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.549510 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.549443 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-242.ec2.internal\": node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.550571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.550556 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.550672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.550584 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.550672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.550600 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.552262 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552235 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.552350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.552403 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552373 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.552939 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552922 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.553033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552946 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.553033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552948 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.553033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552958 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.553033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.552987 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.553033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.553004 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.554441 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.554425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.554526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.554458 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 20:41:57.555307 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.555292 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientMemory" Jun 10 20:41:57.555400 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.555321 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 20:41:57.555400 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.555334 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeHasSufficientPID" Jun 10 20:41:57.562855 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.562839 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.581859 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.581838 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.586116 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.586101 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-242.ec2.internal\" not found" node="ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.663551 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.663527 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.677836 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.677818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949ae2e611a72b6f39dd481124458ba-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"d949ae2e611a72b6f39dd481124458ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.677913 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.677843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.677913 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.677861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.763613 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.763583 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.778963 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.778943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949ae2e611a72b6f39dd481124458ba-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"d949ae2e611a72b6f39dd481124458ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.779040 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.778967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.779040 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.778984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.779040 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.779019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.779165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.779060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9df15546792eed1ea05d5ecbce3eca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal\" (UID: \"b9df15546792eed1ea05d5ecbce3eca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.779165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.779076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d949ae2e611a72b6f39dd481124458ba-config\") pod \"kube-apiserver-proxy-ip-10-0-142-242.ec2.internal\" (UID: \"d949ae2e611a72b6f39dd481124458ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.864124 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.864045 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:57.886515 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.886495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.891864 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:57.891605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:57.965079 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:57.965045 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:58.065577 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.065547 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:58.166161 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.166104 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-242.ec2.internal\" not found" Jun 10 20:41:58.170908 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.170893 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:58.176849 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.176831 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" Jun 10 20:41:58.187862 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.187843 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:41:58.190342 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.190330 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" Jun 10 20:41:58.202785 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.202771 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 20:41:58.318256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.318214 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 20:41:58.318829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.318376 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:41:58.318829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.318402 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:41:58.318829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.318402 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 20:41:58.355533 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.355512 2578 apiserver.go:52] "Watching apiserver" Jun 10 20:41:58.370213 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.370167 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9df15546792eed1ea05d5ecbce3eca2.slice/crio-fb5e72f5752433880ddcda45289233bd301b4ee243ae33fbbf181a310aa9f69f WatchSource:0}: Error finding container fb5e72f5752433880ddcda45289233bd301b4ee243ae33fbbf181a310aa9f69f: Status 404 returned error can't find the container with id fb5e72f5752433880ddcda45289233bd301b4ee243ae33fbbf181a310aa9f69f Jun 10 20:41:58.370779 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.370755 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd949ae2e611a72b6f39dd481124458ba.slice/crio-bd8a0f873d69b90e6e6d988818485f1456f64611a0098b5092fec8f451262542 WatchSource:0}: Error finding container bd8a0f873d69b90e6e6d988818485f1456f64611a0098b5092fec8f451262542: Status 404 returned error can't find the container with id bd8a0f873d69b90e6e6d988818485f1456f64611a0098b5092fec8f451262542 Jun 10 20:41:58.374969 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.374946 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:41:58.377603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.376348 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 20:41:58.377603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.376501 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 20:41:58.378051 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.378031 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-zcxtd","openshift-network-operator/iptables-alerter-vqb98","openshift-ovn-kubernetes/ovnkube-node-zfwpj","kube-system/global-pull-secret-syncer-wm528","kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qltbq","openshift-dns/node-resolver-h7bss","openshift-image-registry/node-ca-k7kpd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal","openshift-multus/multus-additional-cni-plugins-mhnf4","openshift-multus/multus-r4mnf","kube-system/konnectivity-agent-9d6ln","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj","openshift-multus/network-metrics-daemon-cz8dr"] Jun 10 20:41:58.380589 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.380552 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 20:36:57 +0000 UTC" deadline="2028-03-22 11:43:13.156081262 +0000 UTC" Jun 10 20:41:58.380661 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.380593 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15615h1m14.775491383s" Jun 10 20:41:58.380661 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.380576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.381823 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.381806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.383149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.383130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qcrvt\"" Jun 10 20:41:58.383260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.383136 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.383260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.383136 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.383363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.383264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.384484 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.384469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.384547 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.384494 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 20:41:58.384790 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.384771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.384867 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.384787 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 20:41:58.384930 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.384774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-czb9t\"" Jun 10 20:41:58.385044 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.385030 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.385097 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.385081 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:41:58.386050 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.386030 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 20:41:58.386143 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.386062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 20:41:58.386441 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.386428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.386523 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.386486 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:41:58.387584 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 20:41:58.387584 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.387584 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvv5n\"" Jun 10 20:41:58.387584 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387540 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 20:41:58.388073 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387633 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.388073 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.387911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.389336 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.389319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.390347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.390333 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.390414 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.390346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2mtz\"" Jun 10 20:41:58.390605 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.390592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.390978 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.390963 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 20:41:58.391454 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.391438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.391846 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.391821 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.391846 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.391842 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.392062 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.392045 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 20:41:58.392378 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.392361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4svjs\"" Jun 10 20:41:58.393083 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.393067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.394110 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.394049 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 20:41:58.394110 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.394077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t5h7z\"" Jun 10 20:41:58.394466 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.394446 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.394590 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.394564 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.394803 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.394790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.395492 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.395475 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r52jn\"" Jun 10 20:41:58.395704 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.395690 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 20:41:58.395773 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.395757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 20:41:58.395861 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.395757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 20:41:58.396310 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.396296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:41:58.396390 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.396341 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:41:58.397199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.397184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 20:41:58.397299 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.397219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dvgrh\"" Jun 10 20:41:58.397931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.397876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.397931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.397918 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 20:41:58.400785 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.400768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 20:41:58.400892 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.400815 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 20:41:58.400981 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.400970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lxnkx\"" Jun 10 20:41:58.417759 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.417702 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-plw9t" Jun 10 20:41:58.425599 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.425585 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-plw9t" Jun 10 20:41:58.452079 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.452041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"d949ae2e611a72b6f39dd481124458ba","Type":"ContainerStarted","Data":"bd8a0f873d69b90e6e6d988818485f1456f64611a0098b5092fec8f451262542"} Jun 10 20:41:58.453059 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.453033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"b9df15546792eed1ea05d5ecbce3eca2","Type":"ContainerStarted","Data":"fb5e72f5752433880ddcda45289233bd301b4ee243ae33fbbf181a310aa9f69f"} Jun 10 20:41:58.477640 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.477623 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 20:41:58.482188 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19a552b-64ae-4943-aa42-92c453f07c10-tmp-dir\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.482256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-bin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.482256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-cnibin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-cni-binary-copy\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-dbus\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.482367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-conf\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.482367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.482367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-ovn\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-sys-fs\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtsz2\" (UniqueName: \"kubernetes.io/projected/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-kube-api-access-jtsz2\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96k6s\" (UniqueName: \"kubernetes.io/projected/b19a552b-64ae-4943-aa42-92c453f07c10-kube-api-access-96k6s\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-socket-dir-parent\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-kubelet\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-script-lib\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln548\" (UniqueName: \"kubernetes.io/projected/6ef97d51-a54a-4228-acf4-3789074b2f6c-kube-api-access-ln548\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-systemd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-hostroot\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjpv\" (UniqueName: \"kubernetes.io/projected/e86bdc87-d25c-466a-9c13-21d03260eadd-kube-api-access-7hjpv\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482654 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-log-socket\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-etc-selinux\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.482714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjtk2\" (UniqueName: \"kubernetes.io/projected/a123ea22-20c4-4695-9ed7-848eca4e446b-kube-api-access-jjtk2\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482732 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-os-release\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-k8s-cni-cncf-io\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-multus-certs\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70752b45-7466-4136-8d18-c206768846a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef97d51-a54a-4228-acf4-3789074b2f6c-iptables-alerter-script\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-var-lib-kubelet\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19a552b-64ae-4943-aa42-92c453f07c10-hosts-file\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-device-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-modprobe-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482891 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysconfig\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-tmp\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzhxw\" (UniqueName: \"kubernetes.io/projected/b1109e67-568f-45bc-9da0-f92b8f930967-kube-api-access-zzhxw\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-system-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-conf-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-etc-kubernetes\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.482984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-systemd-units\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483094 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-netd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9f7m\" (UniqueName: \"kubernetes.io/projected/70752b45-7466-4136-8d18-c206768846a7-kube-api-access-n9f7m\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-system-cni-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-sys\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-netns\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-netns\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-node-log\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvz47\" (UniqueName: \"kubernetes.io/projected/699db463-ec20-4039-b818-030906f34ee6-kube-api-access-kvz47\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-kubernetes\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-multus\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-var-lib-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.483675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-kubelet-config\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-run\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-tuned\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-os-release\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-agent-certs\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-daemon-config\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-bin\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-registration-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cnibin\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-slash\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483641 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9fq6\" (UniqueName: \"kubernetes.io/projected/61be2b8a-feac-4a56-a54c-5cdd5b18341f-kube-api-access-r9fq6\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1109e67-568f-45bc-9da0-f92b8f930967-host\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1109e67-568f-45bc-9da0-f92b8f930967-serviceca\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-kubelet\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-socket-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483747 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef97d51-a54a-4228-acf4-3789074b2f6c-host-slash\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-etc-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-config\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-env-overrides\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-systemd\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-lib-modules\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483877 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-host\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.484677 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.483904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-konnectivity-ca\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.505834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.505815 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:58.584334 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-etc-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.584334 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-config\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-env-overrides\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-systemd\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-lib-modules\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-etc-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584450 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-systemd\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-host\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-konnectivity-ca\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19a552b-64ae-4943-aa42-92c453f07c10-tmp-dir\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-bin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.584558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-cnibin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-lib-modules\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-cni-binary-copy\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-dbus\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-bin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-conf\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-ovn\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-sys-fs\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-conf\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtsz2\" (UniqueName: \"kubernetes.io/projected/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-kube-api-access-jtsz2\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584786 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-sys-fs\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96k6s\" (UniqueName: \"kubernetes.io/projected/b19a552b-64ae-4943-aa42-92c453f07c10-kube-api-access-96k6s\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-socket-dir-parent\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-kubelet\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-script-lib\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.585130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19a552b-64ae-4943-aa42-92c453f07c10-tmp-dir\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-config\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln548\" (UniqueName: \"kubernetes.io/projected/6ef97d51-a54a-4228-acf4-3789074b2f6c-kube-api-access-ln548\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-env-overrides\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.584990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-ovn\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-systemd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-hostroot\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-cnibin\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjpv\" (UniqueName: \"kubernetes.io/projected/e86bdc87-d25c-466a-9c13-21d03260eadd-kube-api-access-7hjpv\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-log-socket\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-konnectivity-ca\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-etc-selinux\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-host\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjtk2\" (UniqueName: \"kubernetes.io/projected/a123ea22-20c4-4695-9ed7-848eca4e446b-kube-api-access-jjtk2\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-os-release\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-k8s-cni-cncf-io\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-multus-certs\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70752b45-7466-4136-8d18-c206768846a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef97d51-a54a-4228-acf4-3789074b2f6c-iptables-alerter-script\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-var-lib-kubelet\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19a552b-64ae-4943-aa42-92c453f07c10-hosts-file\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-device-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-socket-dir-parent\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-run-systemd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585451 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-os-release\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585415 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-multus-certs\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-modprobe-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysconfig\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.586888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-kubelet\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-tmp\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzhxw\" (UniqueName: \"kubernetes.io/projected/b1109e67-568f-45bc-9da0-f92b8f930967-kube-api-access-zzhxw\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-system-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585593 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-cni-binary-copy\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-conf-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-etc-kubernetes\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-systemd-units\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-netd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-modprobe-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysconfig\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-var-lib-kubelet\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-device-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585868 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-dbus\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-hostroot\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585886 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/70752b45-7466-4136-8d18-c206768846a7-ovnkube-script-lib\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-etc-selinux\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.585943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-system-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.587664 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.585942 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.586008 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:41:59.085986285 +0000 UTC m=+2.066695754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-sysctl-d\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586025 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9f7m\" (UniqueName: \"kubernetes.io/projected/70752b45-7466-4136-8d18-c206768846a7-kube-api-access-n9f7m\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-netd\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-system-cni-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-conf-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-sys\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-systemd-units\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586153 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-k8s-cni-cncf-io\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-netns\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-etc-kubernetes\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.588528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b19a552b-64ae-4943-aa42-92c453f07c10-hosts-file\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-run-netns\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-netns\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586214 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ef97d51-a54a-4228-acf4-3789074b2f6c-iptables-alerter-script\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-system-cni-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586288 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-log-socket\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-cni-dir\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586314 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-sys\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586336 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-run-netns\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-node-log\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586427 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-node-log\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvz47\" (UniqueName: \"kubernetes.io/projected/699db463-ec20-4039-b818-030906f34ee6-kube-api-access-kvz47\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-kubernetes\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-multus\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-var-lib-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.586557 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-kubelet-config\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-run\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586588 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-var-lib-openvswitch\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e86bdc87-d25c-466a-9c13-21d03260eadd-host-var-lib-cni-multus\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-kubernetes\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.586610 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:41:59.086595149 +0000 UTC m=+2.067304606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-kubelet-config\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-tuned\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a123ea22-20c4-4695-9ed7-848eca4e446b-run\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-os-release\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-os-release\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-agent-certs\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-daemon-config\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586838 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-bin\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.589889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-registration-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586897 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-cni-bin\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cnibin\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-slash\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9fq6\" (UniqueName: \"kubernetes.io/projected/61be2b8a-feac-4a56-a54c-5cdd5b18341f-kube-api-access-r9fq6\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-cnibin\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.586966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-registration-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1109e67-568f-45bc-9da0-f92b8f930967-host\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-slash\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1109e67-568f-45bc-9da0-f92b8f930967-host\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1109e67-568f-45bc-9da0-f92b8f930967-serviceca\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-kubelet\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-socket-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef97d51-a54a-4228-acf4-3789074b2f6c-host-slash\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.590347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/70752b45-7466-4136-8d18-c206768846a7-host-kubelet\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ef97d51-a54a-4228-acf4-3789074b2f6c-host-slash\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e86bdc87-d25c-466a-9c13-21d03260eadd-multus-daemon-config\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587449 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/699db463-ec20-4039-b818-030906f34ee6-socket-dir\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.587543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1109e67-568f-45bc-9da0-f92b8f930967-serviceca\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.589276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a19aa2b-e19b-421c-b93a-dc35e31ceb2e-agent-certs\") pod \"konnectivity-agent-9d6ln\" (UID: \"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e\") " pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.589320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-etc-tuned\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.589376 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a123ea22-20c4-4695-9ed7-848eca4e446b-tmp\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.590839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.589397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/70752b45-7466-4136-8d18-c206768846a7-ovn-node-metrics-cert\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.597994 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.597707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96k6s\" (UniqueName: \"kubernetes.io/projected/b19a552b-64ae-4943-aa42-92c453f07c10-kube-api-access-96k6s\") pod \"node-resolver-h7bss\" (UID: \"b19a552b-64ae-4943-aa42-92c453f07c10\") " pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.597994 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.597838 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:58.597994 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.597858 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:58.597994 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.597871 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:58.597994 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:58.597934 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:41:59.097917073 +0000 UTC m=+2.078626525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:58.598389 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.598343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzhxw\" (UniqueName: \"kubernetes.io/projected/b1109e67-568f-45bc-9da0-f92b8f930967-kube-api-access-zzhxw\") pod \"node-ca-k7kpd\" (UID: \"b1109e67-568f-45bc-9da0-f92b8f930967\") " pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.598582 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.598556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9f7m\" (UniqueName: \"kubernetes.io/projected/70752b45-7466-4136-8d18-c206768846a7-kube-api-access-n9f7m\") pod \"ovnkube-node-zfwpj\" (UID: \"70752b45-7466-4136-8d18-c206768846a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.599072 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.598971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjtk2\" (UniqueName: \"kubernetes.io/projected/a123ea22-20c4-4695-9ed7-848eca4e446b-kube-api-access-jjtk2\") pod \"tuned-qltbq\" (UID: \"a123ea22-20c4-4695-9ed7-848eca4e446b\") " pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.599072 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.599005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjpv\" (UniqueName: \"kubernetes.io/projected/e86bdc87-d25c-466a-9c13-21d03260eadd-kube-api-access-7hjpv\") pod \"multus-r4mnf\" (UID: \"e86bdc87-d25c-466a-9c13-21d03260eadd\") " pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.599222 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.599188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvz47\" (UniqueName: \"kubernetes.io/projected/699db463-ec20-4039-b818-030906f34ee6-kube-api-access-kvz47\") pod \"aws-ebs-csi-driver-node-99mwj\" (UID: \"699db463-ec20-4039-b818-030906f34ee6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.599995 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.599962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln548\" (UniqueName: \"kubernetes.io/projected/6ef97d51-a54a-4228-acf4-3789074b2f6c-kube-api-access-ln548\") pod \"iptables-alerter-vqb98\" (UID: \"6ef97d51-a54a-4228-acf4-3789074b2f6c\") " pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.600303 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.600284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtsz2\" (UniqueName: \"kubernetes.io/projected/eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397-kube-api-access-jtsz2\") pod \"multus-additional-cni-plugins-mhnf4\" (UID: \"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397\") " pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.600651 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.600636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9fq6\" (UniqueName: \"kubernetes.io/projected/61be2b8a-feac-4a56-a54c-5cdd5b18341f-kube-api-access-r9fq6\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:58.690494 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.690470 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7bss" Jun 10 20:41:58.697523 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.697505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4mnf" Jun 10 20:41:58.698750 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.698728 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19a552b_64ae_4943_aa42_92c453f07c10.slice/crio-4011a31f8314d56c43e8638611237ceef0f2ae3610c48176e780abba0d234398 WatchSource:0}: Error finding container 4011a31f8314d56c43e8638611237ceef0f2ae3610c48176e780abba0d234398: Status 404 returned error can't find the container with id 4011a31f8314d56c43e8638611237ceef0f2ae3610c48176e780abba0d234398 Jun 10 20:41:58.707349 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.707323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:41:58.707583 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.707555 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86bdc87_d25c_466a_9c13_21d03260eadd.slice/crio-e140df470462840296b501ee9e7ca948af0dead87df0cb937fe7af6b6ec148d1 WatchSource:0}: Error finding container e140df470462840296b501ee9e7ca948af0dead87df0cb937fe7af6b6ec148d1: Status 404 returned error can't find the container with id e140df470462840296b501ee9e7ca948af0dead87df0cb937fe7af6b6ec148d1 Jun 10 20:41:58.710813 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.710791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qltbq" Jun 10 20:41:58.715569 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.715550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k7kpd" Jun 10 20:41:58.715758 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.715737 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70752b45_7466_4136_8d18_c206768846a7.slice/crio-22e1249e82626bb16ff281bb0b4c42418fb867365efb30adcbf9f7d15b4eff24 WatchSource:0}: Error finding container 22e1249e82626bb16ff281bb0b4c42418fb867365efb30adcbf9f7d15b4eff24: Status 404 returned error can't find the container with id 22e1249e82626bb16ff281bb0b4c42418fb867365efb30adcbf9f7d15b4eff24 Jun 10 20:41:58.719528 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.719503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda123ea22_20c4_4695_9ed7_848eca4e446b.slice/crio-2f40d2fff965d46b1e0ec486652c88a114b06dfb9cab93f9da7616945b3a8152 WatchSource:0}: Error finding container 2f40d2fff965d46b1e0ec486652c88a114b06dfb9cab93f9da7616945b3a8152: Status 404 returned error can't find the container with id 2f40d2fff965d46b1e0ec486652c88a114b06dfb9cab93f9da7616945b3a8152 Jun 10 20:41:58.721547 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.721333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" Jun 10 20:41:58.724457 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.724436 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1109e67_568f_45bc_9da0_f92b8f930967.slice/crio-2446ae12a5641033dbb37c178cb916a7e90e34a80bfc953eed66c1ac89f2b292 WatchSource:0}: Error finding container 2446ae12a5641033dbb37c178cb916a7e90e34a80bfc953eed66c1ac89f2b292: Status 404 returned error can't find the container with id 2446ae12a5641033dbb37c178cb916a7e90e34a80bfc953eed66c1ac89f2b292 Jun 10 20:41:58.727844 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.727826 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vqb98" Jun 10 20:41:58.729194 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.729171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699db463_ec20_4039_b818_030906f34ee6.slice/crio-4805058cb3e80d14ae224f1f3b362a58f19424752df0598e216fec06dd77f3e2 WatchSource:0}: Error finding container 4805058cb3e80d14ae224f1f3b362a58f19424752df0598e216fec06dd77f3e2: Status 404 returned error can't find the container with id 4805058cb3e80d14ae224f1f3b362a58f19424752df0598e216fec06dd77f3e2 Jun 10 20:41:58.732738 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.732717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" Jun 10 20:41:58.738168 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:58.738150 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:41:58.738734 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.738704 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef97d51_a54a_4228_acf4_3789074b2f6c.slice/crio-752c4e2eccc0a1bab7e1384f126bc778e7e3013a90189fa47fbb3f4d3a5d873a WatchSource:0}: Error finding container 752c4e2eccc0a1bab7e1384f126bc778e7e3013a90189fa47fbb3f4d3a5d873a: Status 404 returned error can't find the container with id 752c4e2eccc0a1bab7e1384f126bc778e7e3013a90189fa47fbb3f4d3a5d873a Jun 10 20:41:58.742423 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.742400 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea6a1c7_c6ec_4a36_9fa5_7b4d6b88c397.slice/crio-e2b7a63fbcdc44ffb5cfe686f839b10127e3e043ed817c9cf0e0ad8cd9485450 WatchSource:0}: Error finding container e2b7a63fbcdc44ffb5cfe686f839b10127e3e043ed817c9cf0e0ad8cd9485450: Status 404 returned error can't find the container with id e2b7a63fbcdc44ffb5cfe686f839b10127e3e043ed817c9cf0e0ad8cd9485450 Jun 10 20:41:58.747734 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:41:58.747712 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a19aa2b_e19b_421c_b93a_dc35e31ceb2e.slice/crio-fd3291f1b08507df463fcc98a133c3b1bff774619f8efd3fa9f5fc3621e64d0a WatchSource:0}: Error finding container fd3291f1b08507df463fcc98a133c3b1bff774619f8efd3fa9f5fc3621e64d0a: Status 404 returned error can't find the container with id fd3291f1b08507df463fcc98a133c3b1bff774619f8efd3fa9f5fc3621e64d0a Jun 10 20:41:59.090807 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.090732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:41:59.090958 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.090810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:41:59.090958 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.090857 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:59.090958 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.090915 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:59.090958 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.090927 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:00.090906718 +0000 UTC m=+3.071616172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:41:59.091179 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.090964 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:42:00.090948183 +0000 UTC m=+3.071657625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:41:59.191408 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.191365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:41:59.191575 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.191538 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:41:59.191575 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.191558 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:41:59.191575 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.191570 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:59.191810 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:41:59.191623 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:42:00.191604289 +0000 UTC m=+3.172313733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:41:59.427743 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.427638 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:36:58 +0000 UTC" deadline="2027-11-30 23:07:27.617486037 +0000 UTC" Jun 10 20:41:59.427743 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.427698 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12914h25m28.189791742s" Jun 10 20:41:59.488199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.488164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k7kpd" event={"ID":"b1109e67-568f-45bc-9da0-f92b8f930967","Type":"ContainerStarted","Data":"2446ae12a5641033dbb37c178cb916a7e90e34a80bfc953eed66c1ac89f2b292"} Jun 10 20:41:59.499657 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.499624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7bss" event={"ID":"b19a552b-64ae-4943-aa42-92c453f07c10","Type":"ContainerStarted","Data":"4011a31f8314d56c43e8638611237ceef0f2ae3610c48176e780abba0d234398"} Jun 10 20:41:59.509041 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.509010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerStarted","Data":"e2b7a63fbcdc44ffb5cfe686f839b10127e3e043ed817c9cf0e0ad8cd9485450"} Jun 10 20:41:59.519887 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.519863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqb98" event={"ID":"6ef97d51-a54a-4228-acf4-3789074b2f6c","Type":"ContainerStarted","Data":"752c4e2eccc0a1bab7e1384f126bc778e7e3013a90189fa47fbb3f4d3a5d873a"} Jun 10 20:41:59.535455 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.535426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" event={"ID":"699db463-ec20-4039-b818-030906f34ee6","Type":"ContainerStarted","Data":"4805058cb3e80d14ae224f1f3b362a58f19424752df0598e216fec06dd77f3e2"} Jun 10 20:41:59.546383 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.546356 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qltbq" event={"ID":"a123ea22-20c4-4695-9ed7-848eca4e446b","Type":"ContainerStarted","Data":"2f40d2fff965d46b1e0ec486652c88a114b06dfb9cab93f9da7616945b3a8152"} Jun 10 20:41:59.575159 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.575130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"22e1249e82626bb16ff281bb0b4c42418fb867365efb30adcbf9f7d15b4eff24"} Jun 10 20:41:59.580207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.580177 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:41:59.591899 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.591866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4mnf" event={"ID":"e86bdc87-d25c-466a-9c13-21d03260eadd","Type":"ContainerStarted","Data":"e140df470462840296b501ee9e7ca948af0dead87df0cb937fe7af6b6ec148d1"} Jun 10 20:41:59.598056 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.598030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9d6ln" event={"ID":"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e","Type":"ContainerStarted","Data":"fd3291f1b08507df463fcc98a133c3b1bff774619f8efd3fa9f5fc3621e64d0a"} Jun 10 20:41:59.620602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:41:59.620580 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:00.099875 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.099840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:00.100066 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.099944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:00.100129 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.100095 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:00.100179 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.100158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:02.10014024 +0000 UTC m=+5.080849695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:00.100591 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.100570 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:00.100760 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.100626 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:42:02.100611562 +0000 UTC m=+5.081321004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:00.200744 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.200700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:00.200953 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.200908 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:00.200953 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.200928 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:00.200953 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.200940 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:00.201132 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.200996 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:42:02.200978038 +0000 UTC m=+5.181687481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:00.428728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.428630 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 20:36:58 +0000 UTC" deadline="2027-12-21 13:16:25.292923362 +0000 UTC" Jun 10 20:42:00.428728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.428679 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13408h34m24.864248854s" Jun 10 20:42:00.449097 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.449068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:00.449274 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.449210 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:00.449716 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.449693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:00.449822 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.449800 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:00.449894 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:00.449880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:00.449973 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:00.449957 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:01.217489 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:01.217460 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 20:42:02.115423 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.115350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:02.115822 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.115462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:02.115822 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.115533 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:02.115822 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.115578 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:02.115822 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.115601 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:06.115578403 +0000 UTC m=+9.096287855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:02.115822 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.115625 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:42:06.115609909 +0000 UTC m=+9.096319349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:02.216426 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.216348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:02.216684 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.216499 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:02.216684 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.216528 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:02.216684 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.216541 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:02.216684 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.216655 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:42:06.216613899 +0000 UTC m=+9.197323355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:02.449060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.449029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:02.449253 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.449029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:02.449253 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.449160 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:02.449253 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.449192 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:02.449253 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:02.449046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:02.449473 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:02.449286 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:04.449506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:04.449099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:04.449506 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:04.449230 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:04.449506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:04.449333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:04.449506 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:04.449403 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:04.449506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:04.449449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:04.450096 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:04.449520 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:06.150916 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.150878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:06.151419 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.150960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:06.151419 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.151076 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:06.151419 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.151154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:42:14.151134017 +0000 UTC m=+17.131843455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:06.151419 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.151087 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:06.151419 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.151219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:14.151200874 +0000 UTC m=+17.131910314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:06.251332 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.251299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:06.251518 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.251485 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:06.251518 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.251509 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:06.251625 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.251530 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:06.251625 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.251590 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:42:14.251571199 +0000 UTC m=+17.232280652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:06.449779 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.449745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:06.449970 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.449795 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:06.449970 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.449887 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:06.450067 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.449964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:06.450067 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:06.450018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:06.450168 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:06.450086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:08.449152 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:08.448988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:08.449152 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:08.449026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:08.449152 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:08.449027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:08.449152 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:08.449111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:08.449778 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:08.449202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:08.449778 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:08.449317 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:10.449538 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:10.449507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:10.449538 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:10.449542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:10.449962 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:10.449542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:10.449962 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:10.449612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:10.449962 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:10.449731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:10.449962 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:10.449824 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:12.449254 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:12.449223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:12.449651 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:12.449274 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:12.449651 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:12.449349 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:12.449651 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:12.449368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:12.449651 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:12.449435 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:12.449651 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:12.449511 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:14.216553 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.216523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:14.217018 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.216579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:14.217018 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.216690 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:14.217018 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.216696 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:14.217018 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.216753 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:30.216734173 +0000 UTC m=+33.197443818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:14.217018 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.216769 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:42:30.216762866 +0000 UTC m=+33.197472305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:14.317315 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.317289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:14.317445 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.317414 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:14.317445 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.317429 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:14.317445 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.317439 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:14.317557 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.317481 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:42:30.317468812 +0000 UTC m=+33.298178251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:14.449015 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.448982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:14.449015 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.449010 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:14.449239 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:14.449028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:14.449239 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.449111 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:14.449239 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.449199 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:14.449405 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:14.449301 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:16.449505 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:16.449471 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:16.450049 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:16.449597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:16.450049 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:16.449607 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:16.450049 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:16.449601 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:16.450049 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:16.449722 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:16.450049 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:16.449806 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:18.449026 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:18.449007 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:18.449397 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:18.449011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:18.449397 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:18.449124 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:18.449397 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:18.449011 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:18.449397 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:18.449198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:18.449397 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:18.449237 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:19.638285 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.638042 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="a6a456a8d5ca26305a2b6f83f524ccafa89b7e3255989ecda6dce953a7a46537" exitCode=0 Jun 10 20:42:19.639076 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.638129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"a6a456a8d5ca26305a2b6f83f524ccafa89b7e3255989ecda6dce953a7a46537"} Jun 10 20:42:19.639813 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.639791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" event={"ID":"699db463-ec20-4039-b818-030906f34ee6","Type":"ContainerStarted","Data":"4aa0ef6d84720b3392b60257120c090d4703438cae579e7a9944db037a45441c"} Jun 10 20:42:19.641206 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.641183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qltbq" event={"ID":"a123ea22-20c4-4695-9ed7-848eca4e446b","Type":"ContainerStarted","Data":"f63bb69aba73683727fc8bfa50d601aa232835f827bd9a118f5a745cec44e233"} Jun 10 20:42:19.644330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"8e1119be5125de40055ae8e2b189a616600e31eea6ab25069614a6ea95588a3e"} Jun 10 20:42:19.644413 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"81f539038b30254789a9ec27e57d2ceb517f1167c1fdf21f60a0aacbff05031c"} Jun 10 20:42:19.644456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"ce804723d2f0387aee5b9fd6a23e37d005026dc2ce337f69660f48da773ee6bb"} Jun 10 20:42:19.644497 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"0a504e88715e26c736632fe63b021b2b1ec15259759ba823133d0988b417435d"} Jun 10 20:42:19.644576 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"666cac79a1d42289c21387c8dd24e89d5133350f7265c076e9cc59be4bee7af3"} Jun 10 20:42:19.644691 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.644603 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"511a0296418a594b0fa5c13bc57ff1456bf1d290630746e1e0363a486c2d80b6"} Jun 10 20:42:19.645679 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.645660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4mnf" event={"ID":"e86bdc87-d25c-466a-9c13-21d03260eadd","Type":"ContainerStarted","Data":"8b46be70a58ce39e8d9daadab49e0e932f08d48fe1ff240497ca452be734d4d1"} Jun 10 20:42:19.646965 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.646941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" event={"ID":"d949ae2e611a72b6f39dd481124458ba","Type":"ContainerStarted","Data":"5f11893965f14bd92cec443cdfe77e1a1124926173bf544c139f423328e0bfb2"} Jun 10 20:42:19.648298 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.648280 2578 generic.go:356] "Generic (PLEG): container finished" podID="b9df15546792eed1ea05d5ecbce3eca2" containerID="1edc8fa6b23e2973c865f916e72fa98a7880fb57cbde37d1e8ecd1ab549490b0" exitCode=0 Jun 10 20:42:19.648383 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.648338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"b9df15546792eed1ea05d5ecbce3eca2","Type":"ContainerDied","Data":"1edc8fa6b23e2973c865f916e72fa98a7880fb57cbde37d1e8ecd1ab549490b0"} Jun 10 20:42:19.649745 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.649726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9d6ln" event={"ID":"4a19aa2b-e19b-421c-b93a-dc35e31ceb2e","Type":"ContainerStarted","Data":"16baaa998d2f9dcf5faf90a17f58dd73c0f4d398656fbd0a975f969190d6f6fd"} Jun 10 20:42:19.651002 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.650980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k7kpd" event={"ID":"b1109e67-568f-45bc-9da0-f92b8f930967","Type":"ContainerStarted","Data":"94129e383dd93eb19048217f2306fe6848d6b86f004432e2ed066a0b2ea2bf2d"} Jun 10 20:42:19.652194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.652169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7bss" event={"ID":"b19a552b-64ae-4943-aa42-92c453f07c10","Type":"ContainerStarted","Data":"7c9895c70b1cf39e61fe3623ecbcc93a9231f5d5ea43b16682c082a2f2dd8ec1"} Jun 10 20:42:19.678730 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.678683 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9d6ln" podStartSLOduration=3.058745242 podStartE2EDuration="22.67867102s" totalImagesPullingTime="19.619925778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.678368121 +0000 UTC m=+22.659077581" watchObservedRunningTime="2026-06-10 20:42:19.67867102 +0000 UTC m=+22.659380478" Jun 10 20:42:19.693835 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.693619 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-242.ec2.internal" podStartSLOduration=21.69360286 podStartE2EDuration="21.69360286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.693005084 +0000 UTC m=+22.673714545" watchObservedRunningTime="2026-06-10 20:42:19.69360286 +0000 UTC m=+22.674312322" Jun 10 20:42:19.724267 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.724085 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h7bss" podStartSLOduration=3.027197765 podStartE2EDuration="22.724066048s" totalImagesPullingTime="19.696868283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.723463249 +0000 UTC m=+22.704172713" watchObservedRunningTime="2026-06-10 20:42:19.724066048 +0000 UTC m=+22.704775510" Jun 10 20:42:19.741797 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.741767 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qltbq" podStartSLOduration=3.062396966 podStartE2EDuration="22.741754814s" totalImagesPullingTime="19.679357848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.741107539 +0000 UTC m=+22.721817000" watchObservedRunningTime="2026-06-10 20:42:19.741754814 +0000 UTC m=+22.722464272" Jun 10 20:42:19.758179 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.758138 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k7kpd" podStartSLOduration=3.084144781 podStartE2EDuration="22.758125347s" totalImagesPullingTime="19.673980566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.757709337 +0000 UTC m=+22.738418798" watchObservedRunningTime="2026-06-10 20:42:19.758125347 +0000 UTC m=+22.738834807" Jun 10 20:42:19.776967 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:19.775499 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r4mnf" podStartSLOduration=3.053504515 podStartE2EDuration="22.775483028s" totalImagesPullingTime="19.721978513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:19.77521889 +0000 UTC m=+22.755928351" watchObservedRunningTime="2026-06-10 20:42:19.775483028 +0000 UTC m=+22.756192489" Jun 10 20:42:20.448884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.448847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:20.449105 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.448894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:20.449105 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.448894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:20.449105 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:20.448977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:20.449105 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:20.449080 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:20.449305 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:20.449173 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:20.656642 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.656611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" event={"ID":"b9df15546792eed1ea05d5ecbce3eca2","Type":"ContainerStarted","Data":"adbd7a80337fd31050ce8a54ea4dec25e262963c4275a6f3c5c35d502071d7f9"} Jun 10 20:42:20.658075 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.658043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vqb98" event={"ID":"6ef97d51-a54a-4228-acf4-3789074b2f6c","Type":"ContainerStarted","Data":"2337a8c141373d5f50f3a9731676d4e6ce060c0da50c85b0f619b9793a75c590"} Jun 10 20:42:20.696946 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.696797 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vqb98" podStartSLOduration=4.039375668 podStartE2EDuration="23.696779491s" totalImagesPullingTime="19.657403823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:20.680668969 +0000 UTC m=+23.661378432" watchObservedRunningTime="2026-06-10 20:42:20.696779491 +0000 UTC m=+23.677488953" Jun 10 20:42:20.697436 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.697396 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-242.ec2.internal" podStartSLOduration=22.697380666 podStartE2EDuration="22.697380666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:20.696903795 +0000 UTC m=+23.677613260" watchObservedRunningTime="2026-06-10 20:42:20.697380666 +0000 UTC m=+23.678090128" Jun 10 20:42:20.775933 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:20.775908 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 20:42:21.452774 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.452468 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T20:42:20.775930321Z","UUID":"7b29dc0d-2743-46e8-ae16-83bc5f19e495","Handler":null,"Name":"","Endpoint":""} Jun 10 20:42:21.455219 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.455118 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 20:42:21.455219 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.455162 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 20:42:21.663024 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.662929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" event={"ID":"699db463-ec20-4039-b818-030906f34ee6","Type":"ContainerStarted","Data":"430683ab2508eb258dda567f90edc7f49512bde737b0937f431fe0719b26cc35"} Jun 10 20:42:21.666787 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.666732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"7f7d8c907e3e693224548e8660c651fb5c5455fa9a97e70ccccb5b279b591732"} Jun 10 20:42:21.916399 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.916277 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:42:21.916896 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:21.916870 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:42:22.449286 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.449050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:22.449453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.449073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:22.449453 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:22.449381 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:22.449453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.449073 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:22.449591 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:22.449481 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:22.449591 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:22.449527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:22.671819 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.671785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" event={"ID":"699db463-ec20-4039-b818-030906f34ee6","Type":"ContainerStarted","Data":"51f5b97be1b97b2a29f8de32d189b17d94a18b27f284562b6e4b488fbfe0e7b9"} Jun 10 20:42:22.672411 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.671882 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:42:22.672486 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.672469 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9d6ln" Jun 10 20:42:22.694208 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:22.694166 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-99mwj" podStartSLOduration=3.550611743 podStartE2EDuration="25.694148904s" totalImagesPullingTime="22.143537161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:22.693515105 +0000 UTC m=+25.674224566" watchObservedRunningTime="2026-06-10 20:42:22.694148904 +0000 UTC m=+25.674858365" Jun 10 20:42:24.448834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.448804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:24.448834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.448831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:24.449335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.448844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:24.449335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:24.448962 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:24.449335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:24.449043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:24.449335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:24.449112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:24.677878 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.677849 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="fd6d1d2b9dfad7a3f4c6c73adaf8af50fc94a449f4101d251020ac2f2a497922" exitCode=0 Jun 10 20:42:24.678056 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.677945 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"fd6d1d2b9dfad7a3f4c6c73adaf8af50fc94a449f4101d251020ac2f2a497922"} Jun 10 20:42:24.681417 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.681391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" event={"ID":"70752b45-7466-4136-8d18-c206768846a7","Type":"ContainerStarted","Data":"14ae509a722c497ae9aba6dbb9ebe11acfc4b7b853f592c826957f28407e3f1c"} Jun 10 20:42:24.681781 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.681736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:24.681873 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.681805 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:24.696622 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.696604 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:24.732045 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:24.731966 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" podStartSLOduration=7.702111773 podStartE2EDuration="27.73195332s" totalImagesPullingTime="20.029841547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:24.73017285 +0000 UTC m=+27.710882310" watchObservedRunningTime="2026-06-10 20:42:24.73195332 +0000 UTC m=+27.712662780" Jun 10 20:42:25.607701 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.607674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcxtd"] Jun 10 20:42:25.608501 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.607781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:25.608501 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:25.607905 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:25.610752 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.610714 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cz8dr"] Jun 10 20:42:25.610887 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.610852 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:25.610999 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:25.610976 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:25.611290 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.611238 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wm528"] Jun 10 20:42:25.611396 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.611326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:25.611459 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:25.611395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:25.684404 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.684374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:25.699506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:25.699487 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:26.687169 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:26.687130 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="f1caaf080865bc2c7b0bdf3a60443a206975efe3141b8a7943ff0135328e8597" exitCode=0 Jun 10 20:42:26.687631 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:26.687205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"f1caaf080865bc2c7b0bdf3a60443a206975efe3141b8a7943ff0135328e8597"} Jun 10 20:42:27.450337 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:27.450083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:27.450481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:27.450144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:27.450481 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:27.450422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:27.450562 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:27.450510 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:27.450562 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:27.450165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:27.450633 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:27.450593 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:28.261572 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:28.261535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:28.346861 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:28.346827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:28.438912 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:28.438882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:28.694122 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:28.694090 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="d57f6bb21e554f4016f50b2a58d7e38d3ad041d9c334acf2c887c0539a09a993" exitCode=0 Jun 10 20:42:28.694317 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:28.694141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"d57f6bb21e554f4016f50b2a58d7e38d3ad041d9c334acf2c887c0539a09a993"} Jun 10 20:42:29.449265 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:29.449189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:29.449721 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:29.449190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:29.449721 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:29.449345 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:29.449721 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:29.449347 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:29.449721 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:29.449456 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:29.449721 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:29.449571 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:29.567472 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:29.567437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:29.626372 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:29.626340 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:30.236071 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:30.236046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:30.236299 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:30.236111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:30.236299 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.236220 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:30.236299 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.236296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret podName:ecc487f2-72e4-44e1-aefd-a7f52045d4ba nodeName:}" failed. No retries permitted until 2026-06-10 20:43:02.236278447 +0000 UTC m=+65.216987900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret") pod "global-pull-secret-syncer-wm528" (UID: "ecc487f2-72e4-44e1-aefd-a7f52045d4ba") : object "kube-system"/"original-pull-secret" not registered Jun 10 20:42:30.236463 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.236221 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:30.236463 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.236340 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:43:02.236329249 +0000 UTC m=+65.217038687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 20:42:30.278524 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:30.278466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:30.337479 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:30.337450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:30.337627 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.337578 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 20:42:30.337627 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.337595 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 20:42:30.337627 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.337603 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4gv4h for pod openshift-network-diagnostics/network-check-target-zcxtd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:30.337722 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:30.337648 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h podName:33521146-1917-4e29-aa05-f42ad8614ceb nodeName:}" failed. No retries permitted until 2026-06-10 20:43:02.337635904 +0000 UTC m=+65.318345344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4gv4h" (UniqueName: "kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h") pod "network-check-target-zcxtd" (UID: "33521146-1917-4e29-aa05-f42ad8614ceb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 20:42:30.342095 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:30.342065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:31.448936 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:31.448904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:31.448936 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:31.448927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:31.449375 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:31.449038 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wm528" podUID="ecc487f2-72e4-44e1-aefd-a7f52045d4ba" Jun 10 20:42:31.449375 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:31.449091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:31.449375 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:31.449199 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:42:31.449375 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:31.449323 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zcxtd" podUID="33521146-1917-4e29-aa05-f42ad8614ceb" Jun 10 20:42:32.364900 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.364874 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-242.ec2.internal" event="NodeReady" Jun 10 20:42:32.365055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.364999 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 20:42:32.449804 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.449778 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h94w5"] Jun 10 20:42:32.452399 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.452373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.452932 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.452911 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l6hb2"] Jun 10 20:42:32.455939 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.455922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460091 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460223 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460333 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460327 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-822dd\"" Jun 10 20:42:32.460614 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.460448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 20:42:32.469527 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.469468 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h94w5"] Jun 10 20:42:32.471338 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.471018 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6hb2"] Jun 10 20:42:32.484130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.484104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:32.549606 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.549573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:32.556394 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261fe6fc-3f6e-4cd0-b9f3-898922925213-cert\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.556525 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.556525 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcc5k\" (UniqueName: \"kubernetes.io/projected/d7678507-f422-456f-ab16-5520bb03f98f-kube-api-access-wcc5k\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.556525 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7678507-f422-456f-ab16-5520bb03f98f-tmp-dir\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.556648 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7678507-f422-456f-ab16-5520bb03f98f-config-volume\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.556648 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.556630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58p5t\" (UniqueName: \"kubernetes.io/projected/261fe6fc-3f6e-4cd0-b9f3-898922925213-kube-api-access-58p5t\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.657722 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261fe6fc-3f6e-4cd0-b9f3-898922925213-cert\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.657722 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.657955 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcc5k\" (UniqueName: \"kubernetes.io/projected/d7678507-f422-456f-ab16-5520bb03f98f-kube-api-access-wcc5k\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.657955 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7678507-f422-456f-ab16-5520bb03f98f-tmp-dir\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.657955 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7678507-f422-456f-ab16-5520bb03f98f-config-volume\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.657955 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.657936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58p5t\" (UniqueName: \"kubernetes.io/projected/261fe6fc-3f6e-4cd0-b9f3-898922925213-kube-api-access-58p5t\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.658142 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:32.658124 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:32.658204 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:32.658190 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:33.158170403 +0000 UTC m=+36.138879859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:32.658291 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.658230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7678507-f422-456f-ab16-5520bb03f98f-tmp-dir\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.658483 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.658454 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d7678507-f422-456f-ab16-5520bb03f98f-config-volume\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.662540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.662520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/261fe6fc-3f6e-4cd0-b9f3-898922925213-cert\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.667741 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.667716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcc5k\" (UniqueName: \"kubernetes.io/projected/d7678507-f422-456f-ab16-5520bb03f98f-kube-api-access-wcc5k\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:32.668261 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.668225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58p5t\" (UniqueName: \"kubernetes.io/projected/261fe6fc-3f6e-4cd0-b9f3-898922925213-kube-api-access-58p5t\") pod \"ingress-canary-l6hb2\" (UID: \"261fe6fc-3f6e-4cd0-b9f3-898922925213\") " pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:32.768777 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:32.768691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6hb2" Jun 10 20:42:33.161420 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.161329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:33.161581 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:33.161490 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:33.161581 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:33.161567 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:34.161545526 +0000 UTC m=+37.142254966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:33.448848 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.448806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:42:33.449023 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.448806 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:42:33.449086 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.448821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:42:33.453731 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.453683 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:42:33.453731 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.453722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:42:33.454140 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.453742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:42:33.454140 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.453888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:42:33.454140 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.454005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:42:33.454140 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:33.454005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:42:34.057948 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:34.057809 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6hb2"] Jun 10 20:42:34.061054 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:42:34.061028 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261fe6fc_3f6e_4cd0_b9f3_898922925213.slice/crio-1280c8a21c435b7cffe5b16111bf29c72f46edf6bbd187fa33a739ef74b05fa4 WatchSource:0}: Error finding container 1280c8a21c435b7cffe5b16111bf29c72f46edf6bbd187fa33a739ef74b05fa4: Status 404 returned error can't find the container with id 1280c8a21c435b7cffe5b16111bf29c72f46edf6bbd187fa33a739ef74b05fa4 Jun 10 20:42:34.170523 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:34.170502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:34.170619 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:34.170606 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:34.170671 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:34.170662 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:36.170646102 +0000 UTC m=+39.151355541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:34.710041 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:34.710003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6hb2" event={"ID":"261fe6fc-3f6e-4cd0-b9f3-898922925213","Type":"ContainerStarted","Data":"1280c8a21c435b7cffe5b16111bf29c72f46edf6bbd187fa33a739ef74b05fa4"} Jun 10 20:42:34.713530 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:34.713503 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="396e4fab6a734b58bc99a2865055a62b43b3a6de13e3b4a0c4c52af972d764f1" exitCode=0 Jun 10 20:42:34.713661 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:34.713551 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"396e4fab6a734b58bc99a2865055a62b43b3a6de13e3b4a0c4c52af972d764f1"} Jun 10 20:42:35.719047 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:35.719022 2578 generic.go:356] "Generic (PLEG): container finished" podID="eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397" containerID="4b273804e3678563beab928255cd5fff63c74982a8818884a60b001178d68546" exitCode=0 Jun 10 20:42:35.719528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:35.719063 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerDied","Data":"4b273804e3678563beab928255cd5fff63c74982a8818884a60b001178d68546"} Jun 10 20:42:35.917712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:35.917475 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:35.969999 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:35.969917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:36.186679 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.186647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:36.186817 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:36.186801 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:36.186869 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:36.186863 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:40.186848457 +0000 UTC m=+43.167557895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:36.722860 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.722824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6hb2" event={"ID":"261fe6fc-3f6e-4cd0-b9f3-898922925213","Type":"ContainerStarted","Data":"50aa6d766fdf36bdb714bd0ad2f72b84bb72f61eac2f25dd3b6cccef732d537d"} Jun 10 20:42:36.725904 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.725869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" event={"ID":"eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397","Type":"ContainerStarted","Data":"7ca9227ff92a0055e86b3bfb814531d8cb6596d71745fe893a0c154c7f49e6c9"} Jun 10 20:42:36.741580 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.741540 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l6hb2" podStartSLOduration=3.1043769 podStartE2EDuration="4.741526551s" totalImagesPullingTime="1.637149651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:36.740845817 +0000 UTC m=+39.721555278" watchObservedRunningTime="2026-06-10 20:42:36.741526551 +0000 UTC m=+39.722235990" Jun 10 20:42:36.766745 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.766702 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mhnf4" podStartSLOduration=8.651096000999999 podStartE2EDuration="39.766691168s" totalImagesPullingTime="31.115595167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:36.764817819 +0000 UTC m=+39.745527281" watchObservedRunningTime="2026-06-10 20:42:36.766691168 +0000 UTC m=+39.747400629" Jun 10 20:42:36.890525 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.890492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:36.991288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:36.991201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:40.215201 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:40.215151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:40.215602 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:40.215300 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:40.215602 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:40.215362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:42:48.215348783 +0000 UTC m=+51.196058222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:42.818751 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:42.818718 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:42.878294 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:42.878265 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:44.330734 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:44.330701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:44.428786 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:44.428755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:44.482827 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:44.482796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:45.810047 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:45.810016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:47.132904 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.132874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5"] Jun 10 20:42:47.169199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.169170 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5"] Jun 10 20:42:47.169199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.169198 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54"] Jun 10 20:42:47.169382 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.169299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.174103 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.174083 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 20:42:47.175209 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.175187 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 20:42:47.175364 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.175257 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nvj2r\"" Jun 10 20:42:47.175364 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.175275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 20:42:47.176463 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.176448 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 20:42:47.182891 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.182874 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54"] Jun 10 20:42:47.182966 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.182952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.187838 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.187819 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 20:42:47.188681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.188662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 20:42:47.188876 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.188865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 20:42:47.189380 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.189369 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 20:42:47.262503 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3119d31-3fa7-477d-bbe6-a7220f05c89d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.262503 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.262646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.262646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.262646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sglq\" (UniqueName: \"kubernetes.io/projected/f3119d31-3fa7-477d-bbe6-a7220f05c89d-kube-api-access-9sglq\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.262747 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a961836c-1b7a-401d-ba4c-7205d94ef1a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.262747 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkm8m\" (UniqueName: \"kubernetes.io/projected/a961836c-1b7a-401d-ba4c-7205d94ef1a6-kube-api-access-hkm8m\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.262747 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.262727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.363814 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.363788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a961836c-1b7a-401d-ba4c-7205d94ef1a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.363945 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.363823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkm8m\" (UniqueName: \"kubernetes.io/projected/a961836c-1b7a-401d-ba4c-7205d94ef1a6-kube-api-access-hkm8m\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.363945 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.363847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.363976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3119d31-3fa7-477d-bbe6-a7220f05c89d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.364002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.364037 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364200 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.364074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364200 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.364118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sglq\" (UniqueName: \"kubernetes.io/projected/f3119d31-3fa7-477d-bbe6-a7220f05c89d-kube-api-access-9sglq\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.364829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.364803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3119d31-3fa7-477d-bbe6-a7220f05c89d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.367437 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.367416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.367518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.367444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-ca\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.367557 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.367536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.367603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.367580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f3119d31-3fa7-477d-bbe6-a7220f05c89d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.367638 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.367596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a961836c-1b7a-401d-ba4c-7205d94ef1a6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.373332 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.373308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkm8m\" (UniqueName: \"kubernetes.io/projected/a961836c-1b7a-401d-ba4c-7205d94ef1a6-kube-api-access-hkm8m\") pod \"managed-serviceaccount-addon-agent-59c466c998-p25l5\" (UID: \"a961836c-1b7a-401d-ba4c-7205d94ef1a6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.373556 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.373536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sglq\" (UniqueName: \"kubernetes.io/projected/f3119d31-3fa7-477d-bbe6-a7220f05c89d-kube-api-access-9sglq\") pod \"cluster-proxy-proxy-agent-57b4dc864f-j8z54\" (UID: \"f3119d31-3fa7-477d-bbe6-a7220f05c89d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.492043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.492014 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:42:47.498322 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.498300 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:42:47.668199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.668168 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5"] Jun 10 20:42:47.670852 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:42:47.670827 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda961836c_1b7a_401d_ba4c_7205d94ef1a6.slice/crio-0796d1cf700c93e21b37396182e416ed97d78ed55fa0ca154739d98ea30a41fe WatchSource:0}: Error finding container 0796d1cf700c93e21b37396182e416ed97d78ed55fa0ca154739d98ea30a41fe: Status 404 returned error can't find the container with id 0796d1cf700c93e21b37396182e416ed97d78ed55fa0ca154739d98ea30a41fe Jun 10 20:42:47.689125 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.689102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54"] Jun 10 20:42:47.691384 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:42:47.691364 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3119d31_3fa7_477d_bbe6_a7220f05c89d.slice/crio-e53c1304da8bf850285f686bd29d3ae9bbbafd4cd761678fffd2b5d188144e3f WatchSource:0}: Error finding container e53c1304da8bf850285f686bd29d3ae9bbbafd4cd761678fffd2b5d188144e3f: Status 404 returned error can't find the container with id e53c1304da8bf850285f686bd29d3ae9bbbafd4cd761678fffd2b5d188144e3f Jun 10 20:42:47.749850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.749780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerStarted","Data":"e53c1304da8bf850285f686bd29d3ae9bbbafd4cd761678fffd2b5d188144e3f"} Jun 10 20:42:47.750756 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:47.750734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerStarted","Data":"0796d1cf700c93e21b37396182e416ed97d78ed55fa0ca154739d98ea30a41fe"} Jun 10 20:42:48.269940 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:48.269909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:42:48.270386 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:48.270060 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:42:48.270386 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:42:48.270144 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:43:04.270124229 +0000 UTC m=+67.250833682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:42:52.765991 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.765958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerStarted","Data":"25da30b644cb2999e987cd72f28a16df2049f1719f6ecd5de77fe6f8ee54f879"} Jun 10 20:42:52.767875 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.767850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerStarted","Data":"a317d0fbdc61b66ca5626fb5913919fbba46991e7750160d48d94ea0fc4b13ec"} Jun 10 20:42:52.767989 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.767889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerStarted","Data":"656a071fc7634b2bcf4f6ee10778e3dc507519953741c680598154169d6fc35f"} Jun 10 20:42:52.767989 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.767908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerStarted","Data":"459347ff22015e6c1e45bfa9691aabb229897d3fd697e356e4f04cee575bffbc"} Jun 10 20:42:52.784047 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.783963 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" podStartSLOduration=0.894672209 podStartE2EDuration="5.783948616s" totalImagesPullingTime="4.889276407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:52.783387396 +0000 UTC m=+55.764096853" watchObservedRunningTime="2026-06-10 20:42:52.783948616 +0000 UTC m=+55.764658076" Jun 10 20:42:52.803447 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:52.803403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" podStartSLOduration=0.923536087 podStartE2EDuration="5.80338858s" totalImagesPullingTime="4.879852493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:42:52.802714948 +0000 UTC m=+55.783424411" watchObservedRunningTime="2026-06-10 20:42:52.80338858 +0000 UTC m=+55.784098040" Jun 10 20:42:55.566870 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:55.566827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:55.668210 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:55.668171 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:57.708697 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:57.708671 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zfwpj" Jun 10 20:42:57.866926 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:57.866894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:42:57.935137 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:42:57.935110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:02.267947 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.267910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:43:02.268354 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.267960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:43:02.271017 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.270993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 20:43:02.271017 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.271011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 20:43:02.278704 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:02.278683 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:43:02.278807 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:02.278748 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:44:06.278732651 +0000 UTC m=+129.259442093 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : secret "metrics-daemon-secret" not found Jun 10 20:43:02.280680 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.280664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecc487f2-72e4-44e1-aefd-a7f52045d4ba-original-pull-secret\") pod \"global-pull-secret-syncer-wm528\" (UID: \"ecc487f2-72e4-44e1-aefd-a7f52045d4ba\") " pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:43:02.368439 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.368405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:43:02.371415 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.371400 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 20:43:02.381748 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.381730 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 20:43:02.392419 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.392397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gv4h\" (UniqueName: \"kubernetes.io/projected/33521146-1917-4e29-aa05-f42ad8614ceb-kube-api-access-4gv4h\") pod \"network-check-target-zcxtd\" (UID: \"33521146-1917-4e29-aa05-f42ad8614ceb\") " pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:43:02.565187 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.565111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hk7c2\"" Jun 10 20:43:02.568219 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.568197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wm528" Jun 10 20:43:02.571000 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.570979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:43:02.693027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.692995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wm528"] Jun 10 20:43:02.696531 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:43:02.696503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc487f2_72e4_44e1_aefd_a7f52045d4ba.slice/crio-f5d31c045279dad18adb9e1d79dac13f5766f05a8e9816e40188978218da6866 WatchSource:0}: Error finding container f5d31c045279dad18adb9e1d79dac13f5766f05a8e9816e40188978218da6866: Status 404 returned error can't find the container with id f5d31c045279dad18adb9e1d79dac13f5766f05a8e9816e40188978218da6866 Jun 10 20:43:02.716787 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.714612 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zcxtd"] Jun 10 20:43:02.792207 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.792163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcxtd" event={"ID":"33521146-1917-4e29-aa05-f42ad8614ceb","Type":"ContainerStarted","Data":"1e50332349019b86706dd157650aa0568824c1f1cac74284a3245aa7ddaf071f"} Jun 10 20:43:02.793131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:02.793109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wm528" event={"ID":"ecc487f2-72e4-44e1-aefd-a7f52045d4ba","Type":"ContainerStarted","Data":"f5d31c045279dad18adb9e1d79dac13f5766f05a8e9816e40188978218da6866"} Jun 10 20:43:04.283654 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:04.283597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:43:04.284131 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:04.283741 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:04.284131 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:04.283821 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:43:36.283798938 +0000 UTC m=+99.264508383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:43:07.310817 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.310780 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:07.372605 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.372570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:07.424711 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.424682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:07.807761 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.807725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zcxtd" event={"ID":"33521146-1917-4e29-aa05-f42ad8614ceb","Type":"ContainerStarted","Data":"7ee3b68409e8b5092be99d7f4fa26f411d744eb6b7df37891b2a9d7a63e60e66"} Jun 10 20:43:07.807958 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.807906 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:43:07.809149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.809124 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wm528" event={"ID":"ecc487f2-72e4-44e1-aefd-a7f52045d4ba","Type":"ContainerStarted","Data":"975cc9110e046f842dc897b8c2f9dfe9f66ed171669d427b5b738e230f348fde"} Jun 10 20:43:07.827128 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.827087 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zcxtd" podStartSLOduration=66.076264813 podStartE2EDuration="1m10.827076835s" totalImagesPullingTime="4.750812022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:07.825614282 +0000 UTC m=+70.806323743" watchObservedRunningTime="2026-06-10 20:43:07.827076835 +0000 UTC m=+70.807786295" Jun 10 20:43:07.843115 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:07.843075 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wm528" podStartSLOduration=66.071327388 podStartE2EDuration="1m10.843060595s" totalImagesPullingTime="4.771733207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:43:07.842806485 +0000 UTC m=+70.823515945" watchObservedRunningTime="2026-06-10 20:43:07.843060595 +0000 UTC m=+70.823770057" Jun 10 20:43:08.431610 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:08.431573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:08.491803 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:08.491769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:28.340171 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:28.340058 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:33.023798 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:33.023767 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:43:36.301711 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:36.301672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:43:36.302080 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:36.301787 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:43:36.302080 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:43:36.301846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:44:40.3018327 +0000 UTC m=+163.282542139 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:43:38.815367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:43:38.815340 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zcxtd" Jun 10 20:44:06.305575 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:06.305520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:44:06.306054 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:06.305680 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 20:44:06.306054 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:06.305755 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs podName:61be2b8a-feac-4a56-a54c-5cdd5b18341f nodeName:}" failed. No retries permitted until 2026-06-10 20:46:08.305738642 +0000 UTC m=+251.286448084 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs") pod "network-metrics-daemon-cz8dr" (UID: "61be2b8a-feac-4a56-a54c-5cdd5b18341f") : secret "metrics-daemon-secret" not found Jun 10 20:44:35.463309 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:35.463273 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h94w5" podUID="d7678507-f422-456f-ab16-5520bb03f98f" Jun 10 20:44:36.057749 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:36.057724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h94w5" Jun 10 20:44:36.474176 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:36.474141 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cz8dr" podUID="61be2b8a-feac-4a56-a54c-5cdd5b18341f" Jun 10 20:44:40.333007 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:40.332974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:44:40.333462 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:40.333077 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 20:44:40.333462 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:44:40.333137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls podName:d7678507-f422-456f-ab16-5520bb03f98f nodeName:}" failed. No retries permitted until 2026-06-10 20:46:42.333120785 +0000 UTC m=+285.313830240 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls") pod "dns-default-h94w5" (UID: "d7678507-f422-456f-ab16-5520bb03f98f") : secret "dns-default-metrics-tls" not found Jun 10 20:44:47.450098 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:47.450026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:44:51.185143 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:51.185105 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:44:53.105852 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:53.105769 2578 generic.go:356] "Generic (PLEG): container finished" podID="a961836c-1b7a-401d-ba4c-7205d94ef1a6" containerID="25da30b644cb2999e987cd72f28a16df2049f1719f6ecd5de77fe6f8ee54f879" exitCode=255 Jun 10 20:44:53.105852 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:53.105842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerDied","Data":"25da30b644cb2999e987cd72f28a16df2049f1719f6ecd5de77fe6f8ee54f879"} Jun 10 20:44:53.106363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:53.106112 2578 scope.go:117] "RemoveContainer" containerID="25da30b644cb2999e987cd72f28a16df2049f1719f6ecd5de77fe6f8ee54f879" Jun 10 20:44:54.110486 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:44:54.110456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerStarted","Data":"b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151"} Jun 10 20:45:33.840822 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:33.840773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:33.949757 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:33.949719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:34.090060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:34.090028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:34.186671 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:34.186640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:35.774667 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:35.774631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:35.831512 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:35.831470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:38.121555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:38.121515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:38.222837 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:38.222805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:38.323215 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:38.323177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:38.947555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:38.947518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.246950 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.246874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.308925 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.308897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.407151 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.407091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.480097 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.480067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.682655 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.682581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:39.778534 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:39.778502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:41.017220 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:41.017192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:41.290898 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:41.290822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:41.393077 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:41.393046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:41.975964 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:41.975935 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7bss_b19a552b-64ae-4943-aa42-92c453f07c10/dns-node-resolver/0.log" Jun 10 20:45:42.155256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:42.155219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:42.776442 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:42.776413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k7kpd_b1109e67-568f-45bc-9da0-f92b8f930967/node-ca/0.log" Jun 10 20:45:42.971124 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:42.971088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.090852 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.090776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.145453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.145422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.328796 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.328765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.436644 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.436614 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.530701 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.530662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.659585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.659553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:43.777126 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:43.777041 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6hb2_261fe6fc-3f6e-4cd0-b9f3-898922925213/serve-healthcheck-canary/0.log" Jun 10 20:45:44.455797 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:44.455764 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:45.063042 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:45.063010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:45.263387 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:45.263353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:45.312666 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:45.312636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:45.461663 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:45.461632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:45.659552 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:45.659519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:46.703046 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:46.703011 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:46.860529 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:46.860499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:46.915320 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:46.915291 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:47.064213 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:47.064137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:47.313974 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:47.313944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:47.460496 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:47.460467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:47.666257 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:47.666205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:48.659355 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:48.659327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:49.084469 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:49.084439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:49.265651 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:49.265610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:49.463952 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:49.463921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:49.564226 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:49.564196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:49.665468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:49.665438 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:50.865868 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:50.865832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:51.061802 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:51.061770 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:51.172273 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:51.172163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:51.272670 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:51.272638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:51.455145 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:51.455099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:51.654366 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:51.654333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:52.664226 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:52.664199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:52.860612 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:52.860582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:53.259647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:53.259617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:53.463340 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:53.463313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:53.656546 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:53.656460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:53.709018 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:53.708984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:57.819278 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:57.819230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:45:57.919624 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:45:57.919595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:01.331163 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:01.331127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:01.415939 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:01.415902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:01.516734 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:01.516701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:01.617879 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:01.617792 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:01.975137 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:01.975096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:02.034082 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:02.034033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:02.381221 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:02.381145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:02.434854 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:02.434827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:02.792123 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:02.792088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:03.194559 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.194524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:03.404152 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.404110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:03.721890 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.721859 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hwmhm"] Jun 10 20:46:03.725408 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.725389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.728091 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.728074 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 20:46:03.729351 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.729330 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 20:46:03.729455 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.729365 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nzswp\"" Jun 10 20:46:03.729455 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.729382 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 20:46:03.729455 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.729390 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 20:46:03.741075 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.741056 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hwmhm"] Jun 10 20:46:03.794456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.794427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c931145-ba95-46c7-a675-cfe7d0eca9ea-data-volume\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.794456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.794459 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c931145-ba95-46c7-a675-cfe7d0eca9ea-crio-socket\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.794656 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.794479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncgk\" (UniqueName: \"kubernetes.io/projected/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-api-access-dncgk\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.794656 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.794590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.794656 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.794620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c931145-ba95-46c7-a675-cfe7d0eca9ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.812253 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.812223 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-vcmlt"] Jun 10 20:46:03.814331 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.814311 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66968bdff5-4w6fk"] Jun 10 20:46:03.814449 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.814431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:03.816228 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.816210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.817774 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.817759 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 20:46:03.817866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.817855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 20:46:03.818662 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.818645 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 20:46:03.818745 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.818649 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 20:46:03.818811 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.818755 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 20:46:03.819108 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.819092 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-754v9\"" Jun 10 20:46:03.820556 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.820535 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nmgd9\"" Jun 10 20:46:03.826149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.826130 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 20:46:03.831051 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.831032 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vcmlt"] Jun 10 20:46:03.831969 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.831947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66968bdff5-4w6fk"] Jun 10 20:46:03.894910 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.894885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-certificates\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.894910 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.894913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-trusted-ca\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.894935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mshd\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-kube-api-access-8mshd\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.894962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c931145-ba95-46c7-a675-cfe7d0eca9ea-crio-socket\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-tls\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c931145-ba95-46c7-a675-cfe7d0eca9ea-crio-socket\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52wfg\" (UniqueName: \"kubernetes.io/projected/6358effc-c242-4c49-b829-891697d925ea-kube-api-access-52wfg\") pod \"downloads-6657875f97-vcmlt\" (UID: \"6358effc-c242-4c49-b829-891697d925ea\") " pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-image-registry-private-configuration\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-ca-trust-extracted\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-bound-sa-token\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c931145-ba95-46c7-a675-cfe7d0eca9ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncgk\" (UniqueName: \"kubernetes.io/projected/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-api-access-dncgk\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c931145-ba95-46c7-a675-cfe7d0eca9ea-data-volume\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895555 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-installation-pull-secrets\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.895726 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c931145-ba95-46c7-a675-cfe7d0eca9ea-data-volume\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.895761 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.895743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.897667 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.897650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c931145-ba95-46c7-a675-cfe7d0eca9ea-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.898333 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.898307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:03.904291 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.904265 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncgk\" (UniqueName: \"kubernetes.io/projected/2c931145-ba95-46c7-a675-cfe7d0eca9ea-kube-api-access-dncgk\") pod \"insights-runtime-extractor-hwmhm\" (UID: \"2c931145-ba95-46c7-a675-cfe7d0eca9ea\") " pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:03.960594 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.960565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:03.996428 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-certificates\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996428 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-trusted-ca\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996428 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mshd\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-kube-api-access-8mshd\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996440 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-tls\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52wfg\" (UniqueName: \"kubernetes.io/projected/6358effc-c242-4c49-b829-891697d925ea-kube-api-access-52wfg\") pod \"downloads-6657875f97-vcmlt\" (UID: \"6358effc-c242-4c49-b829-891697d925ea\") " pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:03.996585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-image-registry-private-configuration\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996532 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-ca-trust-extracted\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-bound-sa-token\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996817 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-installation-pull-secrets\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.996911 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.996887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-ca-trust-extracted\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.997293 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.997270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-certificates\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.997510 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.997493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-trusted-ca\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.998778 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.998760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-registry-tls\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:03.998882 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:03.998862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-installation-pull-secrets\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:04.000505 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.000486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-image-registry-private-configuration\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:04.005754 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.005725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52wfg\" (UniqueName: \"kubernetes.io/projected/6358effc-c242-4c49-b829-891697d925ea-kube-api-access-52wfg\") pod \"downloads-6657875f97-vcmlt\" (UID: \"6358effc-c242-4c49-b829-891697d925ea\") " pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:04.005828 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.005725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-bound-sa-token\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:04.006093 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.006077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mshd\" (UniqueName: \"kubernetes.io/projected/9ff6aa35-331a-45e4-bd56-0d27bd404bd4-kube-api-access-8mshd\") pod \"image-registry-66968bdff5-4w6fk\" (UID: \"9ff6aa35-331a-45e4-bd56-0d27bd404bd4\") " pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:04.033813 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.033796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hwmhm" Jun 10 20:46:04.103522 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.103489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:04.125125 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.124947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:04.129627 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.129610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:04.159703 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.159678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hwmhm"] Jun 10 20:46:04.162795 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:04.162764 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c931145_ba95_46c7_a675_cfe7d0eca9ea.slice/crio-6e784f8a5b3cac5221cd207076a6cc155a375eb3d1694978b0b7154dbf2b35b7 WatchSource:0}: Error finding container 6e784f8a5b3cac5221cd207076a6cc155a375eb3d1694978b0b7154dbf2b35b7: Status 404 returned error can't find the container with id 6e784f8a5b3cac5221cd207076a6cc155a375eb3d1694978b0b7154dbf2b35b7 Jun 10 20:46:04.164084 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.163975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:04.259233 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.259162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vcmlt"] Jun 10 20:46:04.262303 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:04.262275 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6358effc_c242_4c49_b829_891697d925ea.slice/crio-b97094577a21a39df929996f8f88e15dc8015c3e42a371c29bd9f0f0884621a8 WatchSource:0}: Error finding container b97094577a21a39df929996f8f88e15dc8015c3e42a371c29bd9f0f0884621a8: Status 404 returned error can't find the container with id b97094577a21a39df929996f8f88e15dc8015c3e42a371c29bd9f0f0884621a8 Jun 10 20:46:04.278030 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.278008 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66968bdff5-4w6fk"] Jun 10 20:46:04.280659 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:04.280638 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff6aa35_331a_45e4_bd56_0d27bd404bd4.slice/crio-14615ed450d3bba149b6a753d5632995205bc886cdf5fb5bbcc844623f1cf767 WatchSource:0}: Error finding container 14615ed450d3bba149b6a753d5632995205bc886cdf5fb5bbcc844623f1cf767: Status 404 returned error can't find the container with id 14615ed450d3bba149b6a753d5632995205bc886cdf5fb5bbcc844623f1cf767 Jun 10 20:46:04.307550 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.307522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" event={"ID":"9ff6aa35-331a-45e4-bd56-0d27bd404bd4","Type":"ContainerStarted","Data":"14615ed450d3bba149b6a753d5632995205bc886cdf5fb5bbcc844623f1cf767"} Jun 10 20:46:04.308531 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.308511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vcmlt" event={"ID":"6358effc-c242-4c49-b829-891697d925ea","Type":"ContainerStarted","Data":"b97094577a21a39df929996f8f88e15dc8015c3e42a371c29bd9f0f0884621a8"} Jun 10 20:46:04.309864 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.309847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwmhm" event={"ID":"2c931145-ba95-46c7-a675-cfe7d0eca9ea","Type":"ContainerStarted","Data":"b0310904da4b5abca0050ef7c05e88afb56f4a77df3ee9b1dca9f670b41c8d6a"} Jun 10 20:46:04.309933 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:04.309883 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwmhm" event={"ID":"2c931145-ba95-46c7-a675-cfe7d0eca9ea","Type":"ContainerStarted","Data":"6e784f8a5b3cac5221cd207076a6cc155a375eb3d1694978b0b7154dbf2b35b7"} Jun 10 20:46:05.315523 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:05.315226 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" event={"ID":"9ff6aa35-331a-45e4-bd56-0d27bd404bd4","Type":"ContainerStarted","Data":"1c89d35fbbc38c7ab3f0cd20ad597dff98cfab4edbb5bbdbf5f57327241a9aba"} Jun 10 20:46:05.315523 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:05.315413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:05.317558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:05.317531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwmhm" event={"ID":"2c931145-ba95-46c7-a675-cfe7d0eca9ea","Type":"ContainerStarted","Data":"84b36101829622ce004dc690d7cf0d0559d2afa2ec071fdfd45e27ab6e980ba7"} Jun 10 20:46:05.336342 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:05.336294 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podStartSLOduration=2.336274837 podStartE2EDuration="2.336274837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:05.334914107 +0000 UTC m=+248.315623600" watchObservedRunningTime="2026-06-10 20:46:05.336274837 +0000 UTC m=+248.316984297" Jun 10 20:46:07.141482 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:07.141441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:07.206509 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:07.206468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:07.327533 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:07.327498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hwmhm" event={"ID":"2c931145-ba95-46c7-a675-cfe7d0eca9ea","Type":"ContainerStarted","Data":"c63397812b74a54665f355e1d77311e2618657f7b302085c03fed7cbad846fad"} Jun 10 20:46:07.353659 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:07.353611 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hwmhm" podStartSLOduration=2.367563977 podStartE2EDuration="4.353597052s" totalImagesPullingTime="1.986033075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:07.351561125 +0000 UTC m=+250.332270586" watchObservedRunningTime="2026-06-10 20:46:07.353597052 +0000 UTC m=+250.334306512" Jun 10 20:46:08.169517 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.169482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:08.228585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.228548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:08.330874 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.330848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:46:08.333090 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.333066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61be2b8a-feac-4a56-a54c-5cdd5b18341f-metrics-certs\") pod \"network-metrics-daemon-cz8dr\" (UID: \"61be2b8a-feac-4a56-a54c-5cdd5b18341f\") " pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:46:08.453381 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.453349 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j48kb\"" Jun 10 20:46:08.461233 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.461209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cz8dr" Jun 10 20:46:08.590281 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.590237 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cz8dr"] Jun 10 20:46:08.593221 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:08.593195 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61be2b8a_feac_4a56_a54c_5cdd5b18341f.slice/crio-caf4741d744c237fb2e3bd9c45fed834b5aa1af9b397061f99fc6a20b808557e WatchSource:0}: Error finding container caf4741d744c237fb2e3bd9c45fed834b5aa1af9b397061f99fc6a20b808557e: Status 404 returned error can't find the container with id caf4741d744c237fb2e3bd9c45fed834b5aa1af9b397061f99fc6a20b808557e Jun 10 20:46:08.665335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.665309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:08.766603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.766519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:08.841617 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:08.841581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:09.229813 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:09.229764 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:09.336036 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:09.335996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cz8dr" event={"ID":"61be2b8a-feac-4a56-a54c-5cdd5b18341f","Type":"ContainerStarted","Data":"caf4741d744c237fb2e3bd9c45fed834b5aa1af9b397061f99fc6a20b808557e"} Jun 10 20:46:10.342136 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:10.342104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cz8dr" event={"ID":"61be2b8a-feac-4a56-a54c-5cdd5b18341f","Type":"ContainerStarted","Data":"d0029aa1b3559d061d013e76ed5e518c716236d092537a6b32cc3083ae2c4233"} Jun 10 20:46:10.342561 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:10.342152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cz8dr" event={"ID":"61be2b8a-feac-4a56-a54c-5cdd5b18341f","Type":"ContainerStarted","Data":"ab7d7c6a8d5b374729ac9cd24ae7f1e9daa4b6b7e42d43c2e292a0c50cff3d58"} Jun 10 20:46:10.359300 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:10.359232 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cz8dr" podStartSLOduration=252.422041105 podStartE2EDuration="4m13.359216261s" totalImagesPullingTime="937.175156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:10.35868507 +0000 UTC m=+253.339394532" watchObservedRunningTime="2026-06-10 20:46:10.359216261 +0000 UTC m=+253.339925723" Jun 10 20:46:10.484085 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:10.484045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:10.542792 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:10.542745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:12.846025 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:12.845972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:12.907776 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:12.907744 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:13.216926 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:13.216845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:13.417856 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:13.417822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:13.479105 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:13.479001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:16.607321 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:16.607205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:16.708753 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:16.708715 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:16.760170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:16.760135 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:17.975016 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:17.974978 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.191069 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.191025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.246944 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.246875 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cl5wk"] Jun 10 20:46:18.249912 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.249891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.252549 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.252528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 20:46:18.252886 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.252867 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 20:46:18.254183 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.254056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 20:46:18.254183 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.254088 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 20:46:18.254183 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.254171 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 20:46:18.254436 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.254420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hxgnn\"" Jun 10 20:46:18.254531 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.254496 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 20:46:18.285816 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.285784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.339387 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.339351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.421843 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.421814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422028 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.421863 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwkl\" (UniqueName: \"kubernetes.io/projected/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-kube-api-access-hkwkl\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422028 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.421892 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-metrics-client-ca\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422028 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.421952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-wtmp\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422189 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.422022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422189 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.422057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-root\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422189 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.422101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422189 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.422145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-sys\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.422367 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.422193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-textfile\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.441264 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.441209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.522931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-sys\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.522931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-textfile\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.522931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwkl\" (UniqueName: \"kubernetes.io/projected/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-kube-api-access-hkwkl\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-sys\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.522979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-metrics-client-ca\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523058 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-wtmp\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:46:18.523102 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-root\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523191 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:46:18.523182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls podName:62256b77-0a9d-4ccb-b62b-3ef93a7b0f87 nodeName:}" failed. No retries permitted until 2026-06-10 20:46:19.02316316 +0000 UTC m=+262.003872614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls") pod "node-exporter-cl5wk" (UID: "62256b77-0a9d-4ccb-b62b-3ef93a7b0f87") : secret "node-exporter-tls" not found Jun 10 20:46:18.523672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-wtmp\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-textfile\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-root\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-metrics-client-ca\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.523853 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.523835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-accelerators-collector-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.525922 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.525899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.533124 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.533100 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwkl\" (UniqueName: \"kubernetes.io/projected/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-kube-api-access-hkwkl\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:18.540881 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.540846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.637849 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.637815 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:18.761564 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:18.761529 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:19.027076 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.027042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:19.029720 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.029687 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62256b77-0a9d-4ccb-b62b-3ef93a7b0f87-node-exporter-tls\") pod \"node-exporter-cl5wk\" (UID: \"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87\") " pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:19.161315 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.161285 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cl5wk" Jun 10 20:46:19.203647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.203586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:19.287163 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.287069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:19.935354 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.935296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:19.991703 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:19.991672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:20.312754 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:20.312662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:20.608997 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:20.608911 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:21.165487 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:21.165460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:21.257575 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:21.257533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:21.478390 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:21.478350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:21.620733 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:21.620694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:22.899288 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:22.899257 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62256b77_0a9d_4ccb_b62b_3ef93a7b0f87.slice/crio-3048f9efda89587c140488c590626f782fe1558b370a0333275192860f120f6c WatchSource:0}: Error finding container 3048f9efda89587c140488c590626f782fe1558b370a0333275192860f120f6c: Status 404 returned error can't find the container with id 3048f9efda89587c140488c590626f782fe1558b370a0333275192860f120f6c Jun 10 20:46:23.009977 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.009954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:23.092200 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.092166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:23.389683 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.389560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vcmlt" event={"ID":"6358effc-c242-4c49-b829-891697d925ea","Type":"ContainerStarted","Data":"41f476bf3b8d702cf588d9dcb6504c45acb573c347785c824dc47ae1ba6629c3"} Jun 10 20:46:23.390468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.390380 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:23.391571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.391515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl5wk" event={"ID":"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87","Type":"ContainerStarted","Data":"3048f9efda89587c140488c590626f782fe1558b370a0333275192860f120f6c"} Jun 10 20:46:23.403803 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.403775 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-vcmlt" Jun 10 20:46:23.412005 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.411808 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-vcmlt" podStartSLOduration=1.6959073249999999 podStartE2EDuration="20.411789347s" totalImagesPullingTime="18.715882022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:23.410651465 +0000 UTC m=+266.391360958" watchObservedRunningTime="2026-06-10 20:46:23.411789347 +0000 UTC m=+266.392498809" Jun 10 20:46:23.517050 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:23.516999 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:24.135407 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.135316 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:24.135807 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.135395 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:24.397562 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.397480 2578 generic.go:356] "Generic (PLEG): container finished" podID="62256b77-0a9d-4ccb-b62b-3ef93a7b0f87" containerID="3c870b6660ac997ba2b6252488b6b79a338737b96fb07ef5b69430ddcc13909a" exitCode=0 Jun 10 20:46:24.397728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.397614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl5wk" event={"ID":"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87","Type":"ContainerDied","Data":"3c870b6660ac997ba2b6252488b6b79a338737b96fb07ef5b69430ddcc13909a"} Jun 10 20:46:24.460987 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.460875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:24.465093 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.465069 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:46:24.469126 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.468850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.471594 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.471572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 20:46:24.471879 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.471858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 20:46:24.471964 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.471902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 20:46:24.472068 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.472043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f2rc7\"" Jun 10 20:46:24.472314 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.472296 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 20:46:24.472557 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.472540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 20:46:24.473205 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.473174 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 20:46:24.473425 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.473407 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 20:46:24.473829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.473696 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3hv3pjid8csqa\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474911 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.474912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 20:46:24.475325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.475118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 20:46:24.476508 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.476343 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 20:46:24.486264 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.485895 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:46:24.569681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.569850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.569850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.569850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.569944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570224 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570224 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570224 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570224 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570674 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4l6b\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570674 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.570674 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.570561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671653 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671653 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671880 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671880 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671880 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671880 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.671880 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.671982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4l6b\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672589 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.672884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.672657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.673457 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.673191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.675965 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.673195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.676468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.676442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.676726 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.676701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.676824 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.676736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.677317 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.677293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.677409 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.677378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.677508 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.677488 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.679130 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.679102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680148 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.679688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680148 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.679688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680148 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.679827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680148 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.680056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680442 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.680155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680442 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.680297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.680657 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.680641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.687052 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.687028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4l6b\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b\") pod \"prometheus-k8s-0\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.791237 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.791198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:24.973994 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:24.973626 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:46:24.976259 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:24.976218 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9add95a7_a793_4bb1_83df_24f6908c9f6e.slice/crio-32544a4c6406da903dd2c78694ec7a258e1df4c085abcb81744b6970906803fd WatchSource:0}: Error finding container 32544a4c6406da903dd2c78694ec7a258e1df4c085abcb81744b6970906803fd: Status 404 returned error can't find the container with id 32544a4c6406da903dd2c78694ec7a258e1df4c085abcb81744b6970906803fd Jun 10 20:46:25.403794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:25.403709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl5wk" event={"ID":"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87","Type":"ContainerStarted","Data":"c44658b0d5dbed2d58e595e7a1fed01754b23b8594079e8fb03dff7a43c4e967"} Jun 10 20:46:25.403794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:25.403783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cl5wk" event={"ID":"62256b77-0a9d-4ccb-b62b-3ef93a7b0f87","Type":"ContainerStarted","Data":"def655531440d541f29d9571add7c965bebbb0d0cc4176e0c045bfd5eae6fb9c"} Jun 10 20:46:25.405100 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:25.405071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"32544a4c6406da903dd2c78694ec7a258e1df4c085abcb81744b6970906803fd"} Jun 10 20:46:25.425346 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:25.425289 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cl5wk" podStartSLOduration=6.455217118 podStartE2EDuration="7.425270076s" totalImagesPullingTime="890.840155ms" totalInitContainerRuntime="79.212803ms" isStatefulPod=true podCreationTimestamp="2026-06-10 20:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:25.423154601 +0000 UTC m=+268.403864063" watchObservedRunningTime="2026-06-10 20:46:25.425270076 +0000 UTC m=+268.405979538" Jun 10 20:46:26.327633 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:26.327598 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:26.327804 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:26.327658 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:27.414694 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:27.414652 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" exitCode=0 Jun 10 20:46:27.415122 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:27.414724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} Jun 10 20:46:32.437060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:32.437023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} Jun 10 20:46:32.437483 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:32.437110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} Jun 10 20:46:33.623953 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:33.623912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:34.134751 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:34.134718 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:34.134930 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:34.134765 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:34.446039 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:34.446012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} Jun 10 20:46:35.453556 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:35.453515 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} Jun 10 20:46:35.454008 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:35.453592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} Jun 10 20:46:35.454008 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:35.453631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerStarted","Data":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} Jun 10 20:46:35.499752 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:35.499698 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.287997439 podStartE2EDuration="11.499680865s" totalImagesPullingTime="8.181568818s" totalInitContainerRuntime="30.114608ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:46:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:35.499110849 +0000 UTC m=+278.479820311" watchObservedRunningTime="2026-06-10 20:46:35.499680865 +0000 UTC m=+278.480390325" Jun 10 20:46:36.326438 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:36.326404 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:36.326607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:36.326466 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:39.058311 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:46:39.058270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h94w5" podUID="d7678507-f422-456f-ab16-5520bb03f98f" Jun 10 20:46:39.464308 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:39.464275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:39.791786 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:39.791705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:46:42.419958 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.419913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:42.422131 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.422112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d7678507-f422-456f-ab16-5520bb03f98f-metrics-tls\") pod \"dns-default-h94w5\" (UID: \"d7678507-f422-456f-ab16-5520bb03f98f\") " pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:42.468085 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.468055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqr9w\"" Jun 10 20:46:42.476340 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.476319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:42.631989 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.631952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h94w5"] Jun 10 20:46:42.634647 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:46:42.634623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7678507_f422_456f_ab16_5520bb03f98f.slice/crio-a38784077eb7dac2735db24d648f44f305248c3fc4a70e720268c64cec80d0a1 WatchSource:0}: Error finding container a38784077eb7dac2735db24d648f44f305248c3fc4a70e720268c64cec80d0a1: Status 404 returned error can't find the container with id a38784077eb7dac2735db24d648f44f305248c3fc4a70e720268c64cec80d0a1 Jun 10 20:46:42.831719 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.831684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:42.931479 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:42.931445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:43.279888 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:43.279846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:43.381304 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:43.381266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:43.478305 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:43.478273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h94w5" event={"ID":"d7678507-f422-456f-ab16-5520bb03f98f","Type":"ContainerStarted","Data":"a38784077eb7dac2735db24d648f44f305248c3fc4a70e720268c64cec80d0a1"} Jun 10 20:46:44.134516 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.134485 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:44.134694 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.134533 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:44.134694 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.134573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:46:44.135122 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.135077 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"1c89d35fbbc38c7ab3f0cd20ad597dff98cfab4edbb5bbdbf5f57327241a9aba"} pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 20:46:44.139415 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.139386 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:44.139539 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:44.139439 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:45.486974 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:45.486941 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h94w5" event={"ID":"d7678507-f422-456f-ab16-5520bb03f98f","Type":"ContainerStarted","Data":"a25397aa64d965f370473732769840ce2971f87d1401a7af8de48995ec68ed9e"} Jun 10 20:46:45.487438 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:45.486988 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h94w5" event={"ID":"d7678507-f422-456f-ab16-5520bb03f98f","Type":"ContainerStarted","Data":"78a7ef02ec01c3d719f58899aa98449ac8f10ab07a7d707b093fa9e78a14692b"} Jun 10 20:46:45.487438 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:45.487088 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:45.505974 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:45.505925 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h94w5" podStartSLOduration=251.677018668 podStartE2EDuration="4m13.505909764s" totalImagesPullingTime="1.828891096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:46:45.504372469 +0000 UTC m=+288.485081932" watchObservedRunningTime="2026-06-10 20:46:45.505909764 +0000 UTC m=+288.486619224" Jun 10 20:46:52.930739 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:52.930692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:52.987202 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:52.987173 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:53.515187 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:53.515106 2578 generic.go:356] "Generic (PLEG): container finished" podID="a961836c-1b7a-401d-ba4c-7205d94ef1a6" containerID="b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151" exitCode=255 Jun 10 20:46:53.515187 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:53.515167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerDied","Data":"b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151"} Jun 10 20:46:53.515433 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:53.515203 2578 scope.go:117] "RemoveContainer" containerID="25da30b644cb2999e987cd72f28a16df2049f1719f6ecd5de77fe6f8ee54f879" Jun 10 20:46:53.515529 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:53.515511 2578 scope.go:117] "RemoveContainer" containerID="b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151" Jun 10 20:46:53.515736 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:46:53.515714 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59c466c998-p25l5_open-cluster-management-agent-addon(a961836c-1b7a-401d-ba4c-7205d94ef1a6)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" podUID="a961836c-1b7a-401d-ba4c-7205d94ef1a6" Jun 10 20:46:54.138916 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:54.138885 2578 patch_prober.go:28] interesting pod/image-registry-66968bdff5-4w6fk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 20:46:54.139324 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:54.138940 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:46:55.321144 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:55.321113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:55.492258 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:55.492210 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h94w5" Jun 10 20:46:56.388695 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:56.388656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:57.400778 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:57.400750 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 20:46:57.492269 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:57.492138 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" Jun 10 20:46:57.941790 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:57.492448 2578 scope.go:117] "RemoveContainer" containerID="b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151" Jun 10 20:46:57.941790 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:46:57.492596 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-59c466c998-p25l5_open-cluster-management-agent-addon(a961836c-1b7a-401d-ba4c-7205d94ef1a6)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" podUID="a961836c-1b7a-401d-ba4c-7205d94ef1a6" Jun 10 20:46:57.941790 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:57.499298 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" podUID="f3119d31-3fa7-477d-bbe6-a7220f05c89d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 20:46:58.528057 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:58.528006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:58.628464 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:58.628437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:58.727722 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:58.727690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:58.827980 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:58.827904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:59.237180 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:59.237151 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:46:59.308785 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:46:59.308745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:00.331615 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:00.331582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:00.493161 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:00.493130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:00.596740 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:00.596653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.135475 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.135443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.138636 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.138616 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:47:04.203543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.203512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.279339 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.279306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.379447 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.379414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.479423 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.479394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.539407 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.539374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.620479 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.620445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.723440 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.723408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:04.784547 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:04.784477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:07.499283 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:07.499227 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" podUID="f3119d31-3fa7-477d-bbe6-a7220f05c89d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 20:47:09.154547 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:09.154500 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" podUID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerName="registry" containerID="cri-o://1c89d35fbbc38c7ab3f0cd20ad597dff98cfab4edbb5bbdbf5f57327241a9aba" gracePeriod=30 Jun 10 20:47:10.575158 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:10.575076 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ff6aa35-331a-45e4-bd56-0d27bd404bd4" containerID="1c89d35fbbc38c7ab3f0cd20ad597dff98cfab4edbb5bbdbf5f57327241a9aba" exitCode=0 Jun 10 20:47:10.575158 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:10.575126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" event={"ID":"9ff6aa35-331a-45e4-bd56-0d27bd404bd4","Type":"ContainerDied","Data":"1c89d35fbbc38c7ab3f0cd20ad597dff98cfab4edbb5bbdbf5f57327241a9aba"} Jun 10 20:47:11.450045 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.450008 2578 scope.go:117] "RemoveContainer" containerID="b107cc00d132eb3640a05b256b3ca8e8d8b46f1b3384df2dd5a7b3ad8c43f151" Jun 10 20:47:11.582165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.582130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" event={"ID":"9ff6aa35-331a-45e4-bd56-0d27bd404bd4","Type":"ContainerStarted","Data":"0ba89bfa28134cfccc685b009a6e9732fb35d804aa8e84d8360edd2ca6227efc"} Jun 10 20:47:11.582601 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.582258 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:47:11.584090 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.584071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59c466c998-p25l5" event={"ID":"a961836c-1b7a-401d-ba4c-7205d94ef1a6","Type":"ContainerStarted","Data":"33ae5235bb5cb3a461e3e4b37ad5cb1921bbbec2589704006bd02632dc1a8be2"} Jun 10 20:47:11.888670 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.888596 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:11.937380 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:11.937344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:12.817587 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:12.817557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:12.884553 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:12.884523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:17.499686 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:17.499639 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" podUID="f3119d31-3fa7-477d-bbe6-a7220f05c89d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 20:47:17.500197 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:17.499713 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" Jun 10 20:47:17.500285 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:17.500230 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a317d0fbdc61b66ca5626fb5913919fbba46991e7750160d48d94ea0fc4b13ec"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 20:47:17.500358 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:17.500294 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" podUID="f3119d31-3fa7-477d-bbe6-a7220f05c89d" containerName="service-proxy" containerID="cri-o://a317d0fbdc61b66ca5626fb5913919fbba46991e7750160d48d94ea0fc4b13ec" gracePeriod=30 Jun 10 20:47:18.355030 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:18.354985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:18.609687 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:18.609606 2578 generic.go:356] "Generic (PLEG): container finished" podID="f3119d31-3fa7-477d-bbe6-a7220f05c89d" containerID="a317d0fbdc61b66ca5626fb5913919fbba46991e7750160d48d94ea0fc4b13ec" exitCode=2 Jun 10 20:47:18.610112 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:18.609678 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerDied","Data":"a317d0fbdc61b66ca5626fb5913919fbba46991e7750160d48d94ea0fc4b13ec"} Jun 10 20:47:18.610112 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:18.609729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-57b4dc864f-j8z54" event={"ID":"f3119d31-3fa7-477d-bbe6-a7220f05c89d","Type":"ContainerStarted","Data":"a8d1b446f8ab7bc43c1b95fc23fb18333979b1fc0ca35f44e4162851c6326716"} Jun 10 20:47:24.791759 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:24.791730 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:24.812188 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:24.812162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:25.648452 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:25.648424 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:27.820338 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:27.820302 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:27.921364 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:27.921324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:32.592746 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:32.592717 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66968bdff5-4w6fk" Jun 10 20:47:32.891202 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:32.891118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:32.943737 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:32.943702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:34.336134 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:34.336096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:34.391053 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:34.390998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:40.655354 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:40.655315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:40.756590 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:40.756553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:42.810464 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810429 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:42.810855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810717 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="prometheus" containerID="cri-o://da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" gracePeriod=600 Jun 10 20:47:42.810855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810754 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy" containerID="cri-o://579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" gracePeriod=600 Jun 10 20:47:42.810855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810784 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="thanos-sidecar" containerID="cri-o://7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" gracePeriod=600 Jun 10 20:47:42.810855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810799 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" gracePeriod=600 Jun 10 20:47:42.810855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810804 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-web" containerID="cri-o://8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" gracePeriod=600 Jun 10 20:47:42.811102 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:42.810827 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="config-reloader" containerID="cri-o://72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" gracePeriod=600 Jun 10 20:47:43.043795 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.043767 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.076834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076767 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.076834 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076815 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076841 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076875 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076904 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076933 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076964 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.076984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077003 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077025 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077045 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077082 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4l6b\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077184 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077206 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077233 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077281 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077306 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077321 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls\") pod \"9add95a7-a793-4bb1-83df-24f6908c9f6e\" (UID: \"9add95a7-a793-4bb1-83df-24f6908c9f6e\") " Jun 10 20:47:43.077975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077689 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.077975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.077761 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.078681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.078650 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.079237 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.078912 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.080149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.080017 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:47:43.080602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.080317 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.080990 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.080878 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config" (OuterVolumeSpecName: "config") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.081115 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.080949 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.081210 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.081111 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.081332 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.081306 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 20:47:43.082452 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.082410 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:43.083200 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.083168 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.083962 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.083927 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.084157 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084129 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.084460 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084422 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b" (OuterVolumeSpecName: "kube-api-access-c4l6b") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "kube-api-access-c4l6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:47:43.084559 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084485 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.084624 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084580 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.084812 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084778 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.084917 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.084857 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out" (OuterVolumeSpecName: "config-out") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:47:43.091031 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.091005 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config" (OuterVolumeSpecName: "web-config") pod "9add95a7-a793-4bb1-83df-24f6908c9f6e" (UID: "9add95a7-a793-4bb1-83df-24f6908c9f6e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:47:43.178102 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178076 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178102 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178100 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-grpc-tls\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178111 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178120 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-db\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178128 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-kube-rbac-proxy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178137 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178145 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-web-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178152 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178162 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178171 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178179 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178188 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178197 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-tls-assets\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178204 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9add95a7-a793-4bb1-83df-24f6908c9f6e-config-out\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178211 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-config\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178218 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178226 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9add95a7-a793-4bb1-83df-24f6908c9f6e-secret-metrics-client-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178234 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178265 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9add95a7-a793-4bb1-83df-24f6908c9f6e-configmap-metrics-client-ca\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.178288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.178279 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4l6b\" (UniqueName: \"kubernetes.io/projected/9add95a7-a793-4bb1-83df-24f6908c9f6e-kube-api-access-c4l6b\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:47:43.696760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696729 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" exitCode=0 Jun 10 20:47:43.696760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696756 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" exitCode=0 Jun 10 20:47:43.696760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696762 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" exitCode=0 Jun 10 20:47:43.696760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696768 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" exitCode=0 Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696775 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" exitCode=0 Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696781 2578 generic.go:356] "Generic (PLEG): container finished" podID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" exitCode=0 Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696823 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696950 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696970 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.697021 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.696992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} Jun 10 20:47:43.697333 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.697034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} Jun 10 20:47:43.697333 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.697119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} Jun 10 20:47:43.697333 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.697160 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9add95a7-a793-4bb1-83df-24f6908c9f6e","Type":"ContainerDied","Data":"32544a4c6406da903dd2c78694ec7a258e1df4c085abcb81744b6970906803fd"} Jun 10 20:47:43.704350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.704331 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.711360 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.711345 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.717347 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.717329 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.723742 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.723726 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.723866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.723846 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:43.730401 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.730378 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:43.731098 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.731081 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.737497 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.737483 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.743441 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.743426 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.743683 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.743664 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.743753 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.743695 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.743753 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.743720 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.743946 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.743929 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.743988 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.743953 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.744030 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.743989 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.744189 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.744171 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.744274 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744198 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.744274 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744218 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.744519 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.744504 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.744603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744523 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.744603 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744536 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.744756 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.744740 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.744799 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744760 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.744799 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744777 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.744992 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.744976 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.745051 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.744998 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.745051 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745017 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.745273 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:47:43.745256 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.745317 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745277 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.745317 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745294 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.745503 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745485 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.745568 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745504 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.745740 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745724 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.745786 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745741 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.745964 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745947 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.746008 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.745964 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.746197 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746179 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.746362 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746199 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.746458 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746403 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.746517 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746460 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.746672 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746657 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.746717 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746671 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.746839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746824 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.746839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746837 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.747001 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.746986 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.747001 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747000 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.747191 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747164 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.747229 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747192 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.747434 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747417 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.747481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747433 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.747656 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747639 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.747727 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747658 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.747884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.747929 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.747886 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.748067 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748049 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.748132 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748068 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.748308 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748284 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.748357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748309 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.748524 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748499 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.748588 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748526 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.748733 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748714 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.748796 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748734 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.748950 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748933 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.748987 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.748951 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.749178 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749158 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.749214 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749180 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.749404 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749389 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.749453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749405 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.749594 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749578 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.749594 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749593 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.749809 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749791 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.749850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.749811 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.750029 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750013 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.750081 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750030 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.750259 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750227 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.750328 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750261 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.750483 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750467 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.750545 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750484 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.750712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750696 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.750765 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750713 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.750910 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750895 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.750954 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.750910 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.751091 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751077 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.751136 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751092 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.751294 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751276 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.751350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751295 2578 scope.go:117] "RemoveContainer" containerID="73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104" Jun 10 20:47:43.751468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751452 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104"} err="failed to get container status \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": rpc error: code = NotFound desc = could not find container \"73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104\": container with ID starting with 73ae9ac3985596286f39ae9e0a3529a87496a261b1a19f142f5e93f442ddb104 not found: ID does not exist" Jun 10 20:47:43.751508 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751468 2578 scope.go:117] "RemoveContainer" containerID="579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb" Jun 10 20:47:43.751654 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751640 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb"} err="failed to get container status \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": rpc error: code = NotFound desc = could not find container \"579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb\": container with ID starting with 579b20d10ba24c13baf9211752168c7d67e40c2da2a23c2feeb2f65495d95deb not found: ID does not exist" Jun 10 20:47:43.751691 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751655 2578 scope.go:117] "RemoveContainer" containerID="8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623" Jun 10 20:47:43.751840 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751826 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623"} err="failed to get container status \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": rpc error: code = NotFound desc = could not find container \"8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623\": container with ID starting with 8165b95a4f48354800f0e4fc64dc4b88dd28b1eca704204544c26d72cf4e8623 not found: ID does not exist" Jun 10 20:47:43.751883 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751840 2578 scope.go:117] "RemoveContainer" containerID="7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57" Jun 10 20:47:43.752010 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.751996 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57"} err="failed to get container status \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": rpc error: code = NotFound desc = could not find container \"7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57\": container with ID starting with 7cce019f6d10a56a16a2cf9692367102156ac7e37f4bbf1088a978e9ce4b4d57 not found: ID does not exist" Jun 10 20:47:43.752053 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752010 2578 scope.go:117] "RemoveContainer" containerID="72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626" Jun 10 20:47:43.752225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752209 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626"} err="failed to get container status \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": rpc error: code = NotFound desc = could not find container \"72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626\": container with ID starting with 72ab1916f3b3bcc381d0eec04ce4e36d8344cf7eb8aeaaa4df35ea4cc85d8626 not found: ID does not exist" Jun 10 20:47:43.752280 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752224 2578 scope.go:117] "RemoveContainer" containerID="da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc" Jun 10 20:47:43.752449 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752434 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc"} err="failed to get container status \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": rpc error: code = NotFound desc = could not find container \"da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc\": container with ID starting with da9794c4e45f32ebd3dd442caee953031eddb78f0b43e58714394e2147aa7dcc not found: ID does not exist" Jun 10 20:47:43.752493 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752449 2578 scope.go:117] "RemoveContainer" containerID="9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6" Jun 10 20:47:43.752650 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.752633 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6"} err="failed to get container status \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": rpc error: code = NotFound desc = could not find container \"9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6\": container with ID starting with 9b2f0c3ddf8f65026598da447addaf6c942ae456d20a8a05843e7e2fd1583ba6 not found: ID does not exist" Jun 10 20:47:43.758097 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758077 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:43.758323 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758311 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="config-reloader" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758326 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="config-reloader" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758336 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="init-config-reloader" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758342 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="init-config-reloader" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758354 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="prometheus" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758359 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="prometheus" Jun 10 20:47:43.758363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758364 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758370 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758379 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-web" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758387 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-web" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758396 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-thanos" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758401 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-thanos" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758412 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="thanos-sidecar" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758416 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="thanos-sidecar" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758456 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="prometheus" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758466 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="config-reloader" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758471 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-web" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758476 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758481 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="kube-rbac-proxy-thanos" Jun 10 20:47:43.758540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.758486 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" containerName="thanos-sidecar" Jun 10 20:47:43.762270 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.762254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.765317 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 20:47:43.765417 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 20:47:43.765417 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765411 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 20:47:43.765518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 20:47:43.765568 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765549 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 20:47:43.765568 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765555 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 20:47:43.765804 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765787 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 20:47:43.765884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f2rc7\"" Jun 10 20:47:43.765884 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.765820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 20:47:43.766320 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766306 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 20:47:43.766320 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766313 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3hv3pjid8csqa\"" Jun 10 20:47:43.766648 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766628 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 20:47:43.766780 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 20:47:43.766780 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 20:47:43.766780 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.766702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 20:47:43.769803 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.769784 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 20:47:43.772673 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.772657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 20:47:43.780488 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.780469 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:43.885417 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbkw\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-kube-api-access-qnbkw\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885701 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.885826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.886330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.886330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.886330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.886330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.886330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.885998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbkw\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-kube-api-access-qnbkw\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987377 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.987600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987654 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.987937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988165 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.988013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988535 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.988420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.988606 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.988571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.989931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.989276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.990647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.990348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.990647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.990422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.990647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.990608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.991278 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.990976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.991765 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.991740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992300 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/546b5598-9710-4d3a-a137-4c195869f1f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992358 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992390 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992663 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992647 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992835 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.992984 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.992969 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-config\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.993279 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.993224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/546b5598-9710-4d3a-a137-4c195869f1f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.993354 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.993317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/546b5598-9710-4d3a-a137-4c195869f1f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:43.998486 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:43.998466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbkw\" (UniqueName: \"kubernetes.io/projected/546b5598-9710-4d3a-a137-4c195869f1f2-kube-api-access-qnbkw\") pod \"prometheus-k8s-0\" (UID: \"546b5598-9710-4d3a-a137-4c195869f1f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:44.071003 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:44.070977 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:44.206784 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:44.206755 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 20:47:44.209587 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:47:44.209563 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546b5598_9710_4d3a_a137_4c195869f1f2.slice/crio-19da1c1bba219328b127831178dade3a933918e782b88c2675b3d4f1995c0211 WatchSource:0}: Error finding container 19da1c1bba219328b127831178dade3a933918e782b88c2675b3d4f1995c0211: Status 404 returned error can't find the container with id 19da1c1bba219328b127831178dade3a933918e782b88c2675b3d4f1995c0211 Jun 10 20:47:44.702004 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:44.701976 2578 generic.go:356] "Generic (PLEG): container finished" podID="546b5598-9710-4d3a-a137-4c195869f1f2" containerID="c25080ee974e135e97d8bbe2b10d4940b2e28bbf4148c3226974006ead6252b6" exitCode=0 Jun 10 20:47:44.702151 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:44.702030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerDied","Data":"c25080ee974e135e97d8bbe2b10d4940b2e28bbf4148c3226974006ead6252b6"} Jun 10 20:47:44.702151 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:44.702078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"19da1c1bba219328b127831178dade3a933918e782b88c2675b3d4f1995c0211"} Jun 10 20:47:45.453530 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.453497 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9add95a7-a793-4bb1-83df-24f6908c9f6e" path="/var/lib/kubelet/pods/9add95a7-a793-4bb1-83df-24f6908c9f6e/volumes" Jun 10 20:47:45.712279 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"954f4d844d214014963624cf1a7cede2dc23f5f18a0bdd5b53f1cda177bb08af"} Jun 10 20:47:45.712279 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"cbb686c008cf6b611b069717f47cdef6e66cf35fbcbb51659055e7f07f93ee2a"} Jun 10 20:47:45.712476 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712302 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"3174aff499060c6111b621595381797e37b16812d309a69b6dc868c667d6c84c"} Jun 10 20:47:45.712476 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712326 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"4a1db09600edfe7cc3a6702dd2ce40d47d496fe76b33ff7f6bc5e9759a17f79d"} Jun 10 20:47:45.712476 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"4a9f5f49589e615bfdf7e3df065794a86fb1e48c7292d5542e6e14c8e5e96216"} Jun 10 20:47:45.712476 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.712376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"546b5598-9710-4d3a-a137-4c195869f1f2","Type":"ContainerStarted","Data":"4529e3be892089fa3bf3af3c6bbf7720ae3ebe6e9b49f8e994b34a64abef2597"} Jun 10 20:47:45.742258 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:45.742200 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7244220869999998 podStartE2EDuration="2.742183313s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.761226ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:47:45.740659871 +0000 UTC m=+348.721369332" watchObservedRunningTime="2026-06-10 20:47:45.742183313 +0000 UTC m=+348.722892807" Jun 10 20:47:49.071544 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:49.071501 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:47:57.834522 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:57.834491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:57.931452 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:57.931408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:47:58.031354 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:47:58.031316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:01.564842 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:01.564802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:12.762632 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:12.762602 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:12.814369 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:12.814341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:12.867493 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:12.867468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:40.473523 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:40.473489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:40.574717 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:40.574679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:48:44.071297 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:44.071272 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:48:44.085863 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:44.085837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:48:44.929135 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:48:44.929110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 20:49:06.776534 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:06.776503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:08.113560 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:08.113527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:10.364680 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:10.364649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:10.464287 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:10.464233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:11.361850 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:11.361821 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:11.462163 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:11.462130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:11.859851 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:11.859815 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:11.953037 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:11.952990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:14.671176 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:14.671098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:15.266751 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:15.266718 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:17.167915 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:17.167874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:17.265049 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:17.265006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:20.458877 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:20.458844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:23.083615 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:23.083576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:28.644952 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:28.644915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:40.566718 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:40.566678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:40.671365 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:40.671331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:46.780229 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:46.780196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:46.896157 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:46.896125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:48.578023 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:48.577983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:52.795225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:52.795196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:52.894609 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:52.894573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:56.011968 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:56.011909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:49:56.064017 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:49:56.063981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:01.159696 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:01.159663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:01.253802 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:01.253772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:01.774575 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:01.774541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:01.965582 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:01.965548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.063798 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.063716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.095422 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.095396 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz"] Jun 10 20:50:02.097767 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.097753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.100744 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.100720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 20:50:02.100744 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.100743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m4qdw\"" Jun 10 20:50:02.101071 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.101055 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 20:50:02.101154 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.101084 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 20:50:02.102256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.102223 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 20:50:02.115392 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.115372 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz"] Jun 10 20:50:02.130858 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.130837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.130956 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.130864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.130956 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.130912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lt2b\" (UniqueName: \"kubernetes.io/projected/1058db89-dfbc-4cc1-b018-a3927230c5aa-kube-api-access-4lt2b\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.131032 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.130957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.131032 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.130977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232084 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232084 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lt2b\" (UniqueName: \"kubernetes.io/projected/1058db89-dfbc-4cc1-b018-a3927230c5aa-kube-api-access-4lt2b\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.232571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.232476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-manifests\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.234529 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.234504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1058db89-dfbc-4cc1-b018-a3927230c5aa-tmp\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.234655 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.234640 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.234699 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.234641 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1058db89-dfbc-4cc1-b018-a3927230c5aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.240866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.240848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lt2b\" (UniqueName: \"kubernetes.io/projected/1058db89-dfbc-4cc1-b018-a3927230c5aa-kube-api-access-4lt2b\") pod \"opendatahub-operator-controller-manager-546b599574-dqbpz\" (UID: \"1058db89-dfbc-4cc1-b018-a3927230c5aa\") " pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.245400 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.245357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.346287 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.346177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.407247 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.407223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:02.442289 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.442255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.531784 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.531720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz"] Jun 10 20:50:02.534133 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:02.534107 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1058db89_dfbc_4cc1_b018_a3927230c5aa.slice/crio-ed432b056bd7d6d64884bac092f194a995b227dde04fe0bffdca553ab68246a9 WatchSource:0}: Error finding container ed432b056bd7d6d64884bac092f194a995b227dde04fe0bffdca553ab68246a9: Status 404 returned error can't find the container with id ed432b056bd7d6d64884bac092f194a995b227dde04fe0bffdca553ab68246a9 Jun 10 20:50:02.535868 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.535848 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:50:02.536699 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.536622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:02.611260 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:02.611150 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:03.187457 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:03.187422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" event={"ID":"1058db89-dfbc-4cc1-b018-a3927230c5aa","Type":"ContainerStarted","Data":"ed432b056bd7d6d64884bac092f194a995b227dde04fe0bffdca553ab68246a9"} Jun 10 20:50:06.200908 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:06.200874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" event={"ID":"1058db89-dfbc-4cc1-b018-a3927230c5aa","Type":"ContainerStarted","Data":"0a4eeabdb7b55925da1650f969c3e1c58dc0f3297faddcc2c83ad0eb1e793d5c"} Jun 10 20:50:07.206160 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:07.206123 2578 generic.go:356] "Generic (PLEG): container finished" podID="1058db89-dfbc-4cc1-b018-a3927230c5aa" containerID="0a4eeabdb7b55925da1650f969c3e1c58dc0f3297faddcc2c83ad0eb1e793d5c" exitCode=0 Jun 10 20:50:07.206593 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:07.206216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" event={"ID":"1058db89-dfbc-4cc1-b018-a3927230c5aa","Type":"ContainerDied","Data":"0a4eeabdb7b55925da1650f969c3e1c58dc0f3297faddcc2c83ad0eb1e793d5c"} Jun 10 20:50:08.211615 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:08.211582 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" event={"ID":"1058db89-dfbc-4cc1-b018-a3927230c5aa","Type":"ContainerStarted","Data":"d61600d0d06ace40d74af268780fb9b419286ebd85885d31600a190fdeab4b46"} Jun 10 20:50:08.211975 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:08.211705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:08.233372 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:08.233324 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" podStartSLOduration=2.017793013 podStartE2EDuration="6.233308077s" totalImagesPullingTime="3.241896693s" totalInitContainerRuntime="973.618371ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:08.231106085 +0000 UTC m=+491.211815545" watchObservedRunningTime="2026-06-10 20:50:08.233308077 +0000 UTC m=+491.214017589" Jun 10 20:50:12.697129 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:12.697091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:12.797583 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:12.797541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:19.218149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:19.218122 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-546b599574-dqbpz" Jun 10 20:50:21.314552 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.314520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:21.407522 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.407490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:21.722059 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.722025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:21.827179 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.827143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:21.913662 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.913625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:21.917380 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.917358 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk"] Jun 10 20:50:21.923806 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.923788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:21.926585 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.926564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 20:50:21.926709 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.926639 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 20:50:21.926709 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.926645 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 20:50:21.926815 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.926712 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m984s\"" Jun 10 20:50:21.927658 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.927641 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 20:50:21.930801 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.930775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk"] Jun 10 20:50:21.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.987152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tmp\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:21.987225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.987195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjb6\" (UniqueName: \"kubernetes.io/projected/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-kube-api-access-ltjb6\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:21.987411 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:21.987275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.088167 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.088136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.088335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.088187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tmp\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.088335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.088230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjb6\" (UniqueName: \"kubernetes.io/projected/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-kube-api-access-ltjb6\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.088335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.088306 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.088449 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.088380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs podName:599fbe4f-27e4-4a23-ae28-34f411dc5a3e nodeName:}" failed. No retries permitted until 2026-06-10 20:50:22.58836045 +0000 UTC m=+505.569069895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs") pod "kube-auth-proxy-64cf7df7f-57cwk" (UID: "599fbe4f-27e4-4a23-ae28-34f411dc5a3e") : secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.090371 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.090353 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tmp\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.096147 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.096125 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bdswz"] Jun 10 20:50:22.098230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.098217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.100898 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.100876 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2hdlj\"" Jun 10 20:50:22.100986 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.100876 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 20:50:22.104692 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.104638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjb6\" (UniqueName: \"kubernetes.io/projected/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-kube-api-access-ltjb6\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.106008 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.105985 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bdswz"] Jun 10 20:50:22.125987 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.125964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.189663 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.189630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.189819 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.189680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nng4s\" (UniqueName: \"kubernetes.io/projected/e3492838-ce5a-4930-973d-361575e23b26-kube-api-access-nng4s\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.229715 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.229679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.290552 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.290487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.290552 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.290524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nng4s\" (UniqueName: \"kubernetes.io/projected/e3492838-ce5a-4930-973d-361575e23b26-kube-api-access-nng4s\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.290715 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.290639 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 20:50:22.290715 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.290703 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert podName:e3492838-ce5a-4930-973d-361575e23b26 nodeName:}" failed. No retries permitted until 2026-06-10 20:50:22.790684447 +0000 UTC m=+505.771393894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert") pod "odh-model-controller-6dc94f689f-bdswz" (UID: "e3492838-ce5a-4930-973d-361575e23b26") : secret "odh-model-controller-webhook-cert" not found Jun 10 20:50:22.299230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.299200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nng4s\" (UniqueName: \"kubernetes.io/projected/e3492838-ce5a-4930-973d-361575e23b26-kube-api-access-nng4s\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.324626 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.324580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.429664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.429628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.592793 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.592724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:22.592931 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.592859 2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.592931 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:50:22.592922 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs podName:599fbe4f-27e4-4a23-ae28-34f411dc5a3e nodeName:}" failed. No retries permitted until 2026-06-10 20:50:23.592902544 +0000 UTC m=+506.573611995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs") pod "kube-auth-proxy-64cf7df7f-57cwk" (UID: "599fbe4f-27e4-4a23-ae28-34f411dc5a3e") : secret "kube-auth-proxy-tls" not found Jun 10 20:50:22.795023 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.794990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.797273 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.797255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3492838-ce5a-4930-973d-361575e23b26-cert\") pod \"odh-model-controller-6dc94f689f-bdswz\" (UID: \"e3492838-ce5a-4930-973d-361575e23b26\") " pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:22.798805 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.798776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.802006 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.801984 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-twztt"] Jun 10 20:50:22.804336 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.804308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:22.806739 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.806720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 20:50:22.806867 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.806846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-b6n42\"" Jun 10 20:50:22.816534 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.816511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-twztt"] Jun 10 20:50:22.865582 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.865503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.895823 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.895787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0be923-ea33-4135-98bb-d962dcdb057c-tls-certs\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:22.895978 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.895834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qvbv\" (UniqueName: \"kubernetes.io/projected/2a0be923-ea33-4135-98bb-d962dcdb057c-kube-api-access-5qvbv\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:22.922448 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.922417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:22.996415 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.996386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0be923-ea33-4135-98bb-d962dcdb057c-tls-certs\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:22.996568 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.996429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qvbv\" (UniqueName: \"kubernetes.io/projected/2a0be923-ea33-4135-98bb-d962dcdb057c-kube-api-access-5qvbv\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:22.998801 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:22.998771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a0be923-ea33-4135-98bb-d962dcdb057c-tls-certs\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:23.005891 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.005866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qvbv\" (UniqueName: \"kubernetes.io/projected/2a0be923-ea33-4135-98bb-d962dcdb057c-kube-api-access-5qvbv\") pod \"model-serving-api-5dd488fc48-twztt\" (UID: \"2a0be923-ea33-4135-98bb-d962dcdb057c\") " pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:23.014714 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.014695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:23.114783 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.114758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:23.138219 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.138193 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-bdswz"] Jun 10 20:50:23.144769 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:23.142070 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3492838_ce5a_4930_973d_361575e23b26.slice/crio-a11c5c75b69b6b771272be8132a184e232d9bbe63183c0de2e61e7ee4bef9f3a WatchSource:0}: Error finding container a11c5c75b69b6b771272be8132a184e232d9bbe63183c0de2e61e7ee4bef9f3a: Status 404 returned error can't find the container with id a11c5c75b69b6b771272be8132a184e232d9bbe63183c0de2e61e7ee4bef9f3a Jun 10 20:50:23.240370 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.240338 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-twztt"] Jun 10 20:50:23.243173 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:23.243146 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0be923_ea33_4135_98bb_d962dcdb057c.slice/crio-a77e603de78517fc371b3915477bbc51ff0c4b453634864b51475a46ad795b07 WatchSource:0}: Error finding container a77e603de78517fc371b3915477bbc51ff0c4b453634864b51475a46ad795b07: Status 404 returned error can't find the container with id a77e603de78517fc371b3915477bbc51ff0c4b453634864b51475a46ad795b07 Jun 10 20:50:23.265160 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.265121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" event={"ID":"e3492838-ce5a-4930-973d-361575e23b26","Type":"ContainerStarted","Data":"a11c5c75b69b6b771272be8132a184e232d9bbe63183c0de2e61e7ee4bef9f3a"} Jun 10 20:50:23.266221 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.266202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-twztt" event={"ID":"2a0be923-ea33-4135-98bb-d962dcdb057c","Type":"ContainerStarted","Data":"a77e603de78517fc371b3915477bbc51ff0c4b453634864b51475a46ad795b07"} Jun 10 20:50:23.267735 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.267713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:23.602754 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.602719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:23.605071 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.605048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/599fbe4f-27e4-4a23-ae28-34f411dc5a3e-tls-certs\") pod \"kube-auth-proxy-64cf7df7f-57cwk\" (UID: \"599fbe4f-27e4-4a23-ae28-34f411dc5a3e\") " pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:23.733276 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.733224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" Jun 10 20:50:23.857063 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:23.856984 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk"] Jun 10 20:50:23.860476 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:23.860445 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599fbe4f_27e4_4a23_ae28_34f411dc5a3e.slice/crio-0d8e9699fe889138e4c7c91eb5592dec71a80a8326ce3cbf9d765b749061d80b WatchSource:0}: Error finding container 0d8e9699fe889138e4c7c91eb5592dec71a80a8326ce3cbf9d765b749061d80b: Status 404 returned error can't find the container with id 0d8e9699fe889138e4c7c91eb5592dec71a80a8326ce3cbf9d765b749061d80b Jun 10 20:50:24.273468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:24.273426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" event={"ID":"599fbe4f-27e4-4a23-ae28-34f411dc5a3e","Type":"ContainerStarted","Data":"0d8e9699fe889138e4c7c91eb5592dec71a80a8326ce3cbf9d765b749061d80b"} Jun 10 20:50:28.292531 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.292485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" event={"ID":"599fbe4f-27e4-4a23-ae28-34f411dc5a3e","Type":"ContainerStarted","Data":"0d919ce39c70bad05b0e7040bf056ceabec6e1c0bceaeafc5b608f4235171b55"} Jun 10 20:50:28.293992 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.293968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" event={"ID":"e3492838-ce5a-4930-973d-361575e23b26","Type":"ContainerStarted","Data":"660b57787897a16030b77a203439fc1ead6eba408569dbb3374b162b354ef2d0"} Jun 10 20:50:28.294124 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.294023 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:28.295380 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.295360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-twztt" event={"ID":"2a0be923-ea33-4135-98bb-d962dcdb057c","Type":"ContainerStarted","Data":"21c0b5452638ffbddee5c9936c3d51b8bc84067b28407a680ec8be7098d8fc4b"} Jun 10 20:50:28.295484 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.295472 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:28.329694 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.329650 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64cf7df7f-57cwk" podStartSLOduration=3.04172087 podStartE2EDuration="7.329638968s" totalImagesPullingTime="4.287918098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:28.32855046 +0000 UTC m=+511.309259918" watchObservedRunningTime="2026-06-10 20:50:28.329638968 +0000 UTC m=+511.310348428" Jun 10 20:50:28.353948 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.353910 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" podStartSLOduration=1.358396061 podStartE2EDuration="6.353898303s" totalImagesPullingTime="4.995502242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:28.352255589 +0000 UTC m=+511.332965060" watchObservedRunningTime="2026-06-10 20:50:28.353898303 +0000 UTC m=+511.334607797" Jun 10 20:50:28.387858 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:28.387780 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-twztt" podStartSLOduration=1.488340984 podStartE2EDuration="6.387765686s" totalImagesPullingTime="4.899424702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:28.387219428 +0000 UTC m=+511.367928892" watchObservedRunningTime="2026-06-10 20:50:28.387765686 +0000 UTC m=+511.368475176" Jun 10 20:50:31.818467 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.818416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:31.921736 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.921688 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:31.931818 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.931795 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j7s7n"] Jun 10 20:50:31.934898 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.934881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:31.938707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.938687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 20:50:31.938804 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.938694 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-brbrk\"" Jun 10 20:50:31.955689 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.955665 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz"] Jun 10 20:50:31.958990 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.958970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j7s7n"] Jun 10 20:50:31.959096 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.959072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:31.961815 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.961795 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 20:50:31.962931 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.962909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lrwjb\"" Jun 10 20:50:31.972415 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.972390 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz"] Jun 10 20:50:31.993161 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:31.993118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:32.057821 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.057788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:32.083043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.082986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzg4\" (UniqueName: \"kubernetes.io/projected/52011b4b-6f69-4ca7-b0eb-293042aa1670-kube-api-access-wmzg4\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.083043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.083014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrt6\" (UniqueName: \"kubernetes.io/projected/92397519-6f2c-42ad-bc1f-eff5b1789f55-kube-api-access-cdrt6\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.083156 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.083045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92397519-6f2c-42ad-bc1f-eff5b1789f55-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.083156 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.083089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52011b4b-6f69-4ca7-b0eb-293042aa1670-cert\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.169217 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.169184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:32.184360 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.184332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92397519-6f2c-42ad-bc1f-eff5b1789f55-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.184482 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.184378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52011b4b-6f69-4ca7-b0eb-293042aa1670-cert\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.184482 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.184462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzg4\" (UniqueName: \"kubernetes.io/projected/52011b4b-6f69-4ca7-b0eb-293042aa1670-kube-api-access-wmzg4\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.184592 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.184520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrt6\" (UniqueName: \"kubernetes.io/projected/92397519-6f2c-42ad-bc1f-eff5b1789f55-kube-api-access-cdrt6\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.186837 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.186815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92397519-6f2c-42ad-bc1f-eff5b1789f55-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.187038 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.187023 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52011b4b-6f69-4ca7-b0eb-293042aa1670-cert\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.209724 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.209698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrt6\" (UniqueName: \"kubernetes.io/projected/92397519-6f2c-42ad-bc1f-eff5b1789f55-kube-api-access-cdrt6\") pod \"llmisvc-controller-manager-864bfd7bc9-9pwbz\" (UID: \"92397519-6f2c-42ad-bc1f-eff5b1789f55\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.209810 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.209763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzg4\" (UniqueName: \"kubernetes.io/projected/52011b4b-6f69-4ca7-b0eb-293042aa1670-kube-api-access-wmzg4\") pod \"kserve-controller-manager-69fc866d76-j7s7n\" (UID: \"52011b4b-6f69-4ca7-b0eb-293042aa1670\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.244440 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.244419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:32.268539 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.268518 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:32.271611 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.271583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:32.392019 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.391986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j7s7n"] Jun 10 20:50:32.395503 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:32.395474 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52011b4b_6f69_4ca7_b0eb_293042aa1670.slice/crio-fe255ffc4047f727e99b8581564901c7bff60da88cb835c4e228e21f23b23d68 WatchSource:0}: Error finding container fe255ffc4047f727e99b8581564901c7bff60da88cb835c4e228e21f23b23d68: Status 404 returned error can't find the container with id fe255ffc4047f727e99b8581564901c7bff60da88cb835c4e228e21f23b23d68 Jun 10 20:50:32.410012 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:32.409992 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz"] Jun 10 20:50:32.411671 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:32.411651 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92397519_6f2c_42ad_bc1f_eff5b1789f55.slice/crio-bdecfd8359ff1a5a06c5a124b2605e6a53d705929ca345789b271354522b75ac WatchSource:0}: Error finding container bdecfd8359ff1a5a06c5a124b2605e6a53d705929ca345789b271354522b75ac: Status 404 returned error can't find the container with id bdecfd8359ff1a5a06c5a124b2605e6a53d705929ca345789b271354522b75ac Jun 10 20:50:33.235351 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.235296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:33.321433 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.321394 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" event={"ID":"52011b4b-6f69-4ca7-b0eb-293042aa1670","Type":"ContainerStarted","Data":"fe255ffc4047f727e99b8581564901c7bff60da88cb835c4e228e21f23b23d68"} Jun 10 20:50:33.322961 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.322920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" event={"ID":"92397519-6f2c-42ad-bc1f-eff5b1789f55","Type":"ContainerStarted","Data":"bdecfd8359ff1a5a06c5a124b2605e6a53d705929ca345789b271354522b75ac"} Jun 10 20:50:33.424534 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.424500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:33.569304 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.569218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:33.673547 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:33.673507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:34.167826 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:34.167789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:34.646995 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:34.646880 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:34.788480 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:34.788442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:35.335320 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.335287 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" event={"ID":"52011b4b-6f69-4ca7-b0eb-293042aa1670","Type":"ContainerStarted","Data":"0412b00108c57266825bbce669f783d2756be66e83384ad6956d10ff7f9c9786"} Jun 10 20:50:35.335499 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.335461 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:50:35.362706 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.362651 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" podStartSLOduration=1.897417672 podStartE2EDuration="4.362631471s" totalImagesPullingTime="2.465213799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:35.359045099 +0000 UTC m=+518.339754558" watchObservedRunningTime="2026-06-10 20:50:35.362631471 +0000 UTC m=+518.343340935" Jun 10 20:50:35.853101 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.853022 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7k489"] Jun 10 20:50:35.856334 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.856318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:35.859505 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.859487 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 20:50:35.859618 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.859500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-qzqjs\"" Jun 10 20:50:35.860463 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.860450 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 20:50:35.877577 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:35.877555 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7k489"] Jun 10 20:50:36.019382 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.019348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4sl\" (UniqueName: \"kubernetes.io/projected/eee624ba-9c24-4c7f-85f2-7c08137baaef-kube-api-access-jz4sl\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.019519 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.019395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/eee624ba-9c24-4c7f-85f2-7c08137baaef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.120832 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.120755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4sl\" (UniqueName: \"kubernetes.io/projected/eee624ba-9c24-4c7f-85f2-7c08137baaef-kube-api-access-jz4sl\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.120832 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.120799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/eee624ba-9c24-4c7f-85f2-7c08137baaef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.123199 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.123177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/eee624ba-9c24-4c7f-85f2-7c08137baaef-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.133076 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.133042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4sl\" (UniqueName: \"kubernetes.io/projected/eee624ba-9c24-4c7f-85f2-7c08137baaef-kube-api-access-jz4sl\") pod \"servicemesh-operator3-57f65f65fb-7k489\" (UID: \"eee624ba-9c24-4c7f-85f2-7c08137baaef\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.165336 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.165305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:36.329074 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.329051 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7k489"] Jun 10 20:50:36.331348 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:36.331320 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee624ba_9c24_4c7f_85f2_7c08137baaef.slice/crio-11d3c37db9286e44141aebeab428fbcb5417cc1ad2463478ab130a1ded8ff647 WatchSource:0}: Error finding container 11d3c37db9286e44141aebeab428fbcb5417cc1ad2463478ab130a1ded8ff647: Status 404 returned error can't find the container with id 11d3c37db9286e44141aebeab428fbcb5417cc1ad2463478ab130a1ded8ff647 Jun 10 20:50:36.341042 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.341014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" event={"ID":"92397519-6f2c-42ad-bc1f-eff5b1789f55","Type":"ContainerStarted","Data":"4c4c1dfea4df581f2a1820004f65eacdbcf6efeae2ebbd4b3f098f50c34cac20"} Jun 10 20:50:36.341188 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.341173 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:50:36.342551 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.342532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" event={"ID":"eee624ba-9c24-4c7f-85f2-7c08137baaef","Type":"ContainerStarted","Data":"11d3c37db9286e44141aebeab428fbcb5417cc1ad2463478ab130a1ded8ff647"} Jun 10 20:50:36.385184 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:36.385111 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" podStartSLOduration=2.245586376 podStartE2EDuration="5.385098297s" totalImagesPullingTime="3.139511921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:36.382962184 +0000 UTC m=+519.363671645" watchObservedRunningTime="2026-06-10 20:50:36.385098297 +0000 UTC m=+519.365807757" Jun 10 20:50:37.496404 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.496377 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-j9nvc"] Jun 10 20:50:37.501942 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.501918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.507342 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.507315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-24dwx\"" Jun 10 20:50:37.507469 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.507448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 20:50:37.520854 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.520809 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-j9nvc"] Jun 10 20:50:37.522796 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.522766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:37.631805 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.631767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-redirect-config\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.631980 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.631824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjld\" (UniqueName: \"kubernetes.io/projected/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-kube-api-access-9jjld\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.733410 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.733370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-redirect-config\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.733587 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.733429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjld\" (UniqueName: \"kubernetes.io/projected/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-kube-api-access-9jjld\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.734325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.734294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-redirect-config\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.746873 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.746798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjld\" (UniqueName: \"kubernetes.io/projected/40f6d0ab-8f3f-486d-92c6-dd779b45f73d-kube-api-access-9jjld\") pod \"dashboard-redirect-ccf667d6f-j9nvc\" (UID: \"40f6d0ab-8f3f-486d-92c6-dd779b45f73d\") " pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.815646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.815618 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" Jun 10 20:50:37.975700 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:37.975675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-ccf667d6f-j9nvc"] Jun 10 20:50:37.977535 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:37.977510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40f6d0ab_8f3f_486d_92c6_dd779b45f73d.slice/crio-137c6459e7a0f71484a06d265089ba67fa886f7d11de9041cba01333582ee0d5 WatchSource:0}: Error finding container 137c6459e7a0f71484a06d265089ba67fa886f7d11de9041cba01333582ee0d5: Status 404 returned error can't find the container with id 137c6459e7a0f71484a06d265089ba67fa886f7d11de9041cba01333582ee0d5 Jun 10 20:50:38.352877 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:38.352835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" event={"ID":"40f6d0ab-8f3f-486d-92c6-dd779b45f73d","Type":"ContainerStarted","Data":"137c6459e7a0f71484a06d265089ba67fa886f7d11de9041cba01333582ee0d5"} Jun 10 20:50:39.302292 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:39.302265 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-bdswz" Jun 10 20:50:39.306233 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:39.306208 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-twztt" Jun 10 20:50:39.386169 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:39.382655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" event={"ID":"eee624ba-9c24-4c7f-85f2-7c08137baaef","Type":"ContainerStarted","Data":"d5d36cb21536978c8fe0bd3aea628d085ae7c388c91550bdd3c3f45bec604344"} Jun 10 20:50:39.386169 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:39.383418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:39.413527 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:39.413032 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" podStartSLOduration=1.558705775 podStartE2EDuration="4.413009543s" totalImagesPullingTime="2.854303768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:39.40930543 +0000 UTC m=+522.390014892" watchObservedRunningTime="2026-06-10 20:50:39.413009543 +0000 UTC m=+522.393719004" Jun 10 20:50:43.404537 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:43.404449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" event={"ID":"40f6d0ab-8f3f-486d-92c6-dd779b45f73d","Type":"ContainerStarted","Data":"7576316e71c60009d983b1993b4454bf31b6d16bd1296d8a46b52e176ca69387"} Jun 10 20:50:43.421495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:43.421449 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-ccf667d6f-j9nvc" podStartSLOduration=1.247457684 podStartE2EDuration="6.421435167s" totalImagesPullingTime="5.173977483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:43.420268631 +0000 UTC m=+526.400978092" watchObservedRunningTime="2026-06-10 20:50:43.421435167 +0000 UTC m=+526.402144629" Jun 10 20:50:44.793527 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:44.793439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:44.890842 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:44.890803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:44.990987 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:44.990951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:45.318357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:45.318325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:48.444608 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.444577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:48.548401 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.548292 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:48.800508 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.800423 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb"] Jun 10 20:50:48.803106 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.803091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.805651 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.805628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 20:50:48.805752 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.805705 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-glx5s\"" Jun 10 20:50:48.815518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.815491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb"] Jun 10 20:50:48.823422 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823468 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823641 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823641 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823641 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823610 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh48x\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-kube-api-access-fh48x\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823749 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.823749 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.823705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.826115 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.826091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:48.924399 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924399 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924566 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh48x\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-kube-api-access-fh48x\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924566 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924649 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924729 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924729 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.924889 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.924862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.925091 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.925053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.925422 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.925406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.926824 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.926804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.927183 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.927164 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.932618 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.932601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:48.932892 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:48.932865 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh48x\" (UniqueName: \"kubernetes.io/projected/bbd503d4-8058-4b21-9b7a-3055bef60b4a-kube-api-access-fh48x\") pod \"data-science-gateway-data-science-gateway-class-74759f97958dxzb\" (UID: \"bbd503d4-8058-4b21-9b7a-3055bef60b4a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:49.033256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.033202 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:49.113062 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.112990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:49.134959 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.134931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:49.242537 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.242513 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb"] Jun 10 20:50:49.245048 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:50:49.245019 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd503d4_8058_4b21_9b7a_3055bef60b4a.slice/crio-500185a984e95731990bec62cd16e31a7352a163c362a10641526e30478e91ee WatchSource:0}: Error finding container 500185a984e95731990bec62cd16e31a7352a163c362a10641526e30478e91ee: Status 404 returned error can't find the container with id 500185a984e95731990bec62cd16e31a7352a163c362a10641526e30478e91ee Jun 10 20:50:49.430149 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.430074 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" event={"ID":"bbd503d4-8058-4b21-9b7a-3055bef60b4a","Type":"ContainerStarted","Data":"500185a984e95731990bec62cd16e31a7352a163c362a10641526e30478e91ee"} Jun 10 20:50:49.613982 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:49.613949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:51.394331 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:51.394302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7k489" Jun 10 20:50:52.002710 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:52.002675 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:50:52.002837 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:52.002755 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:50:52.002837 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:52.002785 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:50:52.445461 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:52.445430 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" event={"ID":"bbd503d4-8058-4b21-9b7a-3055bef60b4a","Type":"ContainerStarted","Data":"ae32884cd5906684ed65c5ce06c1b2ae2620acbc6aac1919d4a48459b89175d7"} Jun 10 20:50:52.476750 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:52.476701 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" podStartSLOduration=1.7218347729999999 podStartE2EDuration="4.476684194s" totalImagesPullingTime="2.754849421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:50:52.475409543 +0000 UTC m=+535.456119006" watchObservedRunningTime="2026-06-10 20:50:52.476684194 +0000 UTC m=+535.457393715" Jun 10 20:50:53.113506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:53.113469 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:53.118716 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:53.118689 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:53.453952 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:53.453928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:53.454333 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:53.453990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958dxzb" Jun 10 20:50:55.832422 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:55.832381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:57.752740 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:57.752709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:57.809841 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:57.809802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:57.984737 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:57.984699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:50:58.085746 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:50:58.085663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:06.347299 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:06.347271 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-j7s7n" Jun 10 20:51:07.349655 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:07.349625 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-9pwbz" Jun 10 20:51:16.277948 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:16.277908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:22.915815 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:22.915783 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:23.014068 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.014015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:23.060855 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.060822 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:23.086701 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.086674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:23.086885 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.086768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:23.089746 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.089714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 20:51:23.090755 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.090737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xs7nc\"" Jun 10 20:51:23.090882 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.090767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 20:51:23.111026 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.110995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:23.209559 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.209529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frsdq\" (UniqueName: \"kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq\") pod \"kuadrant-operator-catalog-q962t\" (UID: \"a53680c2-2f60-40b6-a0d3-e76ad05e5420\") " pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:23.310993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.310952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frsdq\" (UniqueName: \"kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq\") pod \"kuadrant-operator-catalog-q962t\" (UID: \"a53680c2-2f60-40b6-a0d3-e76ad05e5420\") " pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:23.323350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.323322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frsdq\" (UniqueName: \"kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq\") pod \"kuadrant-operator-catalog-q962t\" (UID: \"a53680c2-2f60-40b6-a0d3-e76ad05e5420\") " pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:23.396256 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.396221 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:23.417419 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.417387 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:23.531092 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.531041 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:23.533485 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:51:23.533461 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53680c2_2f60_40b6_a0d3_e76ad05e5420.slice/crio-a3c1e56178a22af1ddbf465424f1d48599dab8b8186d6fa2c71bd1ff27dbde7f WatchSource:0}: Error finding container a3c1e56178a22af1ddbf465424f1d48599dab8b8186d6fa2c71bd1ff27dbde7f: Status 404 returned error can't find the container with id a3c1e56178a22af1ddbf465424f1d48599dab8b8186d6fa2c71bd1ff27dbde7f Jun 10 20:51:23.583817 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.583783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q962t" event={"ID":"a53680c2-2f60-40b6-a0d3-e76ad05e5420","Type":"ContainerStarted","Data":"a3c1e56178a22af1ddbf465424f1d48599dab8b8186d6fa2c71bd1ff27dbde7f"} Jun 10 20:51:23.625591 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.625564 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n2rlv"] Jun 10 20:51:23.628708 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.628694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:23.637028 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.636998 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n2rlv"] Jun 10 20:51:23.714091 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.714058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrct\" (UniqueName: \"kubernetes.io/projected/71efe025-d306-48f9-b9d3-4269b476904f-kube-api-access-kzrct\") pod \"kuadrant-operator-catalog-n2rlv\" (UID: \"71efe025-d306-48f9-b9d3-4269b476904f\") " pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:23.815310 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.815214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrct\" (UniqueName: \"kubernetes.io/projected/71efe025-d306-48f9-b9d3-4269b476904f-kube-api-access-kzrct\") pod \"kuadrant-operator-catalog-n2rlv\" (UID: \"71efe025-d306-48f9-b9d3-4269b476904f\") " pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:23.825615 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.825579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrct\" (UniqueName: \"kubernetes.io/projected/71efe025-d306-48f9-b9d3-4269b476904f-kube-api-access-kzrct\") pod \"kuadrant-operator-catalog-n2rlv\" (UID: \"71efe025-d306-48f9-b9d3-4269b476904f\") " pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:23.938134 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:23.938099 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:24.064893 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:24.064870 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n2rlv"] Jun 10 20:51:24.067407 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:51:24.067350 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71efe025_d306_48f9_b9d3_4269b476904f.slice/crio-153a629818c6314d68b09d53c42cafb30d0d6437e7225fa14ea6ff0d8d6a92c9 WatchSource:0}: Error finding container 153a629818c6314d68b09d53c42cafb30d0d6437e7225fa14ea6ff0d8d6a92c9: Status 404 returned error can't find the container with id 153a629818c6314d68b09d53c42cafb30d0d6437e7225fa14ea6ff0d8d6a92c9 Jun 10 20:51:24.590504 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:24.590468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" event={"ID":"71efe025-d306-48f9-b9d3-4269b476904f","Type":"ContainerStarted","Data":"153a629818c6314d68b09d53c42cafb30d0d6437e7225fa14ea6ff0d8d6a92c9"} Jun 10 20:51:26.603640 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.603602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" event={"ID":"71efe025-d306-48f9-b9d3-4269b476904f","Type":"ContainerStarted","Data":"d170252aef551fd5629adf00ea81dc5584ac3cac93858e77d9365b281870e723"} Jun 10 20:51:26.605266 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.605229 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q962t" event={"ID":"a53680c2-2f60-40b6-a0d3-e76ad05e5420","Type":"ContainerStarted","Data":"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602"} Jun 10 20:51:26.605383 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.605274 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-q962t" podUID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" containerName="registry-server" containerID="cri-o://4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602" gracePeriod=2 Jun 10 20:51:26.658334 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.658290 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" podStartSLOduration=2.037553431 podStartE2EDuration="3.658273854s" totalImagesPullingTime="1.620720423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:51:26.6326111 +0000 UTC m=+569.613320562" watchObservedRunningTime="2026-06-10 20:51:26.658273854 +0000 UTC m=+569.638983316" Jun 10 20:51:26.658543 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.658524 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-q962t" podStartSLOduration=1.507122611 podStartE2EDuration="3.658516436s" totalImagesPullingTime="2.151393825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:51:26.65785901 +0000 UTC m=+569.638568492" watchObservedRunningTime="2026-06-10 20:51:26.658516436 +0000 UTC m=+569.639225897" Jun 10 20:51:26.851040 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.851018 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:26.945874 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.945847 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frsdq\" (UniqueName: \"kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq\") pod \"a53680c2-2f60-40b6-a0d3-e76ad05e5420\" (UID: \"a53680c2-2f60-40b6-a0d3-e76ad05e5420\") " Jun 10 20:51:26.947921 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:26.947887 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq" (OuterVolumeSpecName: "kube-api-access-frsdq") pod "a53680c2-2f60-40b6-a0d3-e76ad05e5420" (UID: "a53680c2-2f60-40b6-a0d3-e76ad05e5420"). InnerVolumeSpecName "kube-api-access-frsdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:51:27.047180 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.047148 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frsdq\" (UniqueName: \"kubernetes.io/projected/a53680c2-2f60-40b6-a0d3-e76ad05e5420-kube-api-access-frsdq\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:51:27.610717 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.610685 2578 generic.go:356] "Generic (PLEG): container finished" podID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" containerID="4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602" exitCode=0 Jun 10 20:51:27.611087 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.610728 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-q962t" Jun 10 20:51:27.611087 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.610766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q962t" event={"ID":"a53680c2-2f60-40b6-a0d3-e76ad05e5420","Type":"ContainerDied","Data":"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602"} Jun 10 20:51:27.611087 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.610811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-q962t" event={"ID":"a53680c2-2f60-40b6-a0d3-e76ad05e5420","Type":"ContainerDied","Data":"a3c1e56178a22af1ddbf465424f1d48599dab8b8186d6fa2c71bd1ff27dbde7f"} Jun 10 20:51:27.611087 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.610837 2578 scope.go:117] "RemoveContainer" containerID="4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602" Jun 10 20:51:27.619364 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.619326 2578 scope.go:117] "RemoveContainer" containerID="4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602" Jun 10 20:51:27.619590 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:51:27.619571 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602\": container with ID starting with 4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602 not found: ID does not exist" containerID="4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602" Jun 10 20:51:27.619635 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.619601 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602"} err="failed to get container status \"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602\": rpc error: code = NotFound desc = could not find container \"4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602\": container with ID starting with 4fb4261d5921ca4c9664ea0003ad0be7103b7cfd29f012e9927a99c2527aa602 not found: ID does not exist" Jun 10 20:51:27.627602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.627580 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:27.639083 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:27.639060 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-q962t"] Jun 10 20:51:29.454403 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:29.454369 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" path="/var/lib/kubelet/pods/a53680c2-2f60-40b6-a0d3-e76ad05e5420/volumes" Jun 10 20:51:29.684836 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:29.684797 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:29.790495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:29.790411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:30.381518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:30.381480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:30.434318 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:30.434287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:33.938915 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:33.938875 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:33.939339 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:33.938975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:33.960294 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:33.960269 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:34.665647 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:34.665621 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n2rlv" Jun 10 20:51:42.388442 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:42.388390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:42.450403 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:42.450373 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:42.507316 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:42.507280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:53.784657 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:53.784621 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:56.741597 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:56.741560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:51:59.780320 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.780283 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v"] Jun 10 20:51:59.785906 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.780618 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" containerName="registry-server" Jun 10 20:51:59.785906 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.780628 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" containerName="registry-server" Jun 10 20:51:59.785906 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.780676 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53680c2-2f60-40b6-a0d3-e76ad05e5420" containerName="registry-server" Jun 10 20:51:59.786090 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.785930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:51:59.788866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.788848 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-22tnb\"" Jun 10 20:51:59.789310 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.789294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 20:51:59.794602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.794576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v"] Jun 10 20:51:59.916939 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:51:59.916914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szx2c\" (UniqueName: \"kubernetes.io/projected/e8f17026-db84-483d-80dd-95516415eb58-kube-api-access-szx2c\") pod \"dns-operator-controller-manager-864dd78c4c-4wg8v\" (UID: \"e8f17026-db84-483d-80dd-95516415eb58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:00.017833 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:00.017794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szx2c\" (UniqueName: \"kubernetes.io/projected/e8f17026-db84-483d-80dd-95516415eb58-kube-api-access-szx2c\") pod \"dns-operator-controller-manager-864dd78c4c-4wg8v\" (UID: \"e8f17026-db84-483d-80dd-95516415eb58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:00.030673 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:00.030611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szx2c\" (UniqueName: \"kubernetes.io/projected/e8f17026-db84-483d-80dd-95516415eb58-kube-api-access-szx2c\") pod \"dns-operator-controller-manager-864dd78c4c-4wg8v\" (UID: \"e8f17026-db84-483d-80dd-95516415eb58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:00.097595 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:00.097568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:00.228678 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:00.228654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v"] Jun 10 20:52:00.231124 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:00.231098 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f17026_db84_483d_80dd_95516415eb58.slice/crio-50b3f5e45afdbf297cd511f4638ca0175c74dfeddbb5773790925169928d794b WatchSource:0}: Error finding container 50b3f5e45afdbf297cd511f4638ca0175c74dfeddbb5773790925169928d794b: Status 404 returned error can't find the container with id 50b3f5e45afdbf297cd511f4638ca0175c74dfeddbb5773790925169928d794b Jun 10 20:52:00.756598 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:00.756563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" event={"ID":"e8f17026-db84-483d-80dd-95516415eb58","Type":"ContainerStarted","Data":"50b3f5e45afdbf297cd511f4638ca0175c74dfeddbb5773790925169928d794b"} Jun 10 20:52:01.560779 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:01.560744 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:02.766845 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:02.766812 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" event={"ID":"e8f17026-db84-483d-80dd-95516415eb58","Type":"ContainerStarted","Data":"8980255a460d3c73bf692179e1db2e4cefa98c474921463bf381692dbe31c306"} Jun 10 20:52:02.767229 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:02.766933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:02.785161 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:02.785116 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" podStartSLOduration=1.6925935239999998 podStartE2EDuration="3.785101987s" totalImagesPullingTime="2.092508463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:02.784395955 +0000 UTC m=+605.765105417" watchObservedRunningTime="2026-06-10 20:52:02.785101987 +0000 UTC m=+605.765811447" Jun 10 20:52:03.825151 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:03.825121 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f"] Jun 10 20:52:03.828468 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:03.828451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:03.832630 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:03.832609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rczf8\"" Jun 10 20:52:03.847158 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:03.844187 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f"] Jun 10 20:52:03.950771 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:03.950741 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8wh\" (UniqueName: \"kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh\") pod \"limitador-operator-controller-manager-859d7b78bd-7j49f\" (UID: \"1635304f-7d73-4eb0-9f1e-15343493bb33\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:04.051323 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.051294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8wh\" (UniqueName: \"kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh\") pod \"limitador-operator-controller-manager-859d7b78bd-7j49f\" (UID: \"1635304f-7d73-4eb0-9f1e-15343493bb33\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:04.062141 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.062112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8wh\" (UniqueName: \"kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh\") pod \"limitador-operator-controller-manager-859d7b78bd-7j49f\" (UID: \"1635304f-7d73-4eb0-9f1e-15343493bb33\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:04.138107 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.138040 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:04.282365 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.282336 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f"] Jun 10 20:52:04.290680 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:04.290657 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1635304f_7d73_4eb0_9f1e_15343493bb33.slice/crio-539226b32cc2d75ba3cb3ad4441a1e23e3fdea10a5750362d29f0a140c486b24 WatchSource:0}: Error finding container 539226b32cc2d75ba3cb3ad4441a1e23e3fdea10a5750362d29f0a140c486b24: Status 404 returned error can't find the container with id 539226b32cc2d75ba3cb3ad4441a1e23e3fdea10a5750362d29f0a140c486b24 Jun 10 20:52:04.576531 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.576486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:04.779436 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:04.779406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" event={"ID":"1635304f-7d73-4eb0-9f1e-15343493bb33","Type":"ContainerStarted","Data":"539226b32cc2d75ba3cb3ad4441a1e23e3fdea10a5750362d29f0a140c486b24"} Jun 10 20:52:05.814259 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:05.814188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:06.789885 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:06.789849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" event={"ID":"1635304f-7d73-4eb0-9f1e-15343493bb33","Type":"ContainerStarted","Data":"cfa490336bdba73446f66199f197265cd2da2d75ea5f6fd01ea0792be81bc32e"} Jun 10 20:52:06.790052 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:06.789912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:06.810891 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:06.810843 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" podStartSLOduration=2.209163944 podStartE2EDuration="3.810829519s" totalImagesPullingTime="1.601665575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:06.809087918 +0000 UTC m=+609.789797378" watchObservedRunningTime="2026-06-10 20:52:06.810829519 +0000 UTC m=+609.791538980" Jun 10 20:52:07.220435 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:07.220403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:08.726312 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.726274 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4"] Jun 10 20:52:08.729787 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.729767 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:08.732495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.732474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f4ktb\"" Jun 10 20:52:08.742502 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.742476 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4"] Jun 10 20:52:08.896196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.896162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42gj\" (UniqueName: \"kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:08.896396 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.896235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:08.997059 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.996972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:08.997059 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.997030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42gj\" (UniqueName: \"kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:08.997475 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:08.997452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:09.008051 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.008019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42gj\" (UniqueName: \"kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:09.039990 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.039966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:09.056101 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.056073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:09.153273 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.153222 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:09.172271 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.172235 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4"] Jun 10 20:52:09.174220 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:09.174193 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f47d5f3_8441_45b5_b1a3_7383515cb468.slice/crio-40af36b57e52e1cb0e943137140cc98913cace756055b97c6bb68de039e5cd07 WatchSource:0}: Error finding container 40af36b57e52e1cb0e943137140cc98913cace756055b97c6bb68de039e5cd07: Status 404 returned error can't find the container with id 40af36b57e52e1cb0e943137140cc98913cace756055b97c6bb68de039e5cd07 Jun 10 20:52:09.804344 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.804218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" event={"ID":"9f47d5f3-8441-45b5-b1a3-7383515cb468","Type":"ContainerStarted","Data":"40af36b57e52e1cb0e943137140cc98913cace756055b97c6bb68de039e5cd07"} Jun 10 20:52:09.953886 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:09.953854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:11.580793 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:11.580764 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:11.684904 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:11.684874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:13.773768 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:13.773736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-4wg8v" Jun 10 20:52:14.162773 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:14.162553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:14.338400 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:14.338362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:16.839545 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:16.839503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" event={"ID":"9f47d5f3-8441-45b5-b1a3-7383515cb468","Type":"ContainerStarted","Data":"078470e377430d2c8978607cce23ef0dfce2bcd6a9d67a4862b99f28fb486798"} Jun 10 20:52:16.839903 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:16.839633 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:16.864100 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:16.864055 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" podStartSLOduration=1.736829512 podStartE2EDuration="8.864040762s" totalImagesPullingTime="7.12721125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:16.863237995 +0000 UTC m=+619.843947457" watchObservedRunningTime="2026-06-10 20:52:16.864040762 +0000 UTC m=+619.844750299" Jun 10 20:52:17.750134 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:17.750102 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:17.797101 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:17.797078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:17.818734 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:17.818709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:19.166653 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.166620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:19.171536 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.171473 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7"] Jun 10 20:52:19.174989 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.174970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.178370 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.178351 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xmmbv\"" Jun 10 20:52:19.178602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.178575 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 20:52:19.178691 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.178599 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 20:52:19.191067 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.191042 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7"] Jun 10 20:52:19.288765 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.288731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpx2\" (UniqueName: \"kubernetes.io/projected/36212c9a-e0bf-4e4c-9482-c8557a930174-kube-api-access-kkpx2\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.288940 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.288871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/36212c9a-e0bf-4e4c-9482-c8557a930174-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.288940 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.288903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.389376 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.389347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpx2\" (UniqueName: \"kubernetes.io/projected/36212c9a-e0bf-4e4c-9482-c8557a930174-kube-api-access-kkpx2\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.389562 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.389442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/36212c9a-e0bf-4e4c-9482-c8557a930174-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.389562 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.389472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.389687 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:19.389572 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 20:52:19.389687 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:19.389637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert podName:36212c9a-e0bf-4e4c-9482-c8557a930174 nodeName:}" failed. No retries permitted until 2026-06-10 20:52:19.889617092 +0000 UTC m=+622.870326533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-w4rj7" (UID: "36212c9a-e0bf-4e4c-9482-c8557a930174") : secret "plugin-serving-cert" not found Jun 10 20:52:19.390061 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.390034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/36212c9a-e0bf-4e4c-9482-c8557a930174-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.400237 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.400215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpx2\" (UniqueName: \"kubernetes.io/projected/36212c9a-e0bf-4e4c-9482-c8557a930174-kube-api-access-kkpx2\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.636363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.636316 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:19.894305 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.894190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:19.896707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:19.896685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/36212c9a-e0bf-4e4c-9482-c8557a930174-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w4rj7\" (UID: \"36212c9a-e0bf-4e4c-9482-c8557a930174\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:20.084307 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:20.084262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" Jun 10 20:52:20.215574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:20.215549 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7"] Jun 10 20:52:20.860461 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:20.860420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" event={"ID":"36212c9a-e0bf-4e4c-9482-c8557a930174","Type":"ContainerStarted","Data":"ac7604034c10d81d211be1acf96af3662f7be11489069933379bc1285168f210"} Jun 10 20:52:21.242744 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:21.242711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:21.343440 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:21.343384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:27.846635 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:27.846602 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:29.379746 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.379706 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:29.479619 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.479583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:29.625060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.625028 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4"] Jun 10 20:52:29.625292 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.625256 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" containerName="manager" containerID="cri-o://078470e377430d2c8978607cce23ef0dfce2bcd6a9d67a4862b99f28fb486798" gracePeriod=2 Jun 10 20:52:29.635925 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.635561 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4"] Jun 10 20:52:29.639627 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.639585 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9f47d5f3-8441-45b5-b1a3-7383515cb468\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-282m4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:29.649168 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.649143 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f"] Jun 10 20:52:29.649422 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.649391 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" containerName="manager" containerID="cri-o://cfa490336bdba73446f66199f197265cd2da2d75ea5f6fd01ea0792be81bc32e" gracePeriod=2 Jun 10 20:52:29.651988 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.651957 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:29.652330 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.652304 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:29.652727 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.652709 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" containerName="manager" Jun 10 20:52:29.652727 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.652728 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" containerName="manager" Jun 10 20:52:29.652878 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.652800 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" containerName="manager" Jun 10 20:52:29.656779 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.656761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.659767 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.659740 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f"] Jun 10 20:52:29.666965 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.666753 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1635304f-7d73-4eb0-9f1e-15343493bb33\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7j49f\": pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:29.669829 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.669771 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:29.673481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.673457 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2"] Jun 10 20:52:29.673949 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.673930 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" containerName="manager" Jun 10 20:52:29.673949 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.673949 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" containerName="manager" Jun 10 20:52:29.674099 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.674031 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" containerName="manager" Jun 10 20:52:29.677220 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.677201 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:29.687078 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.687015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2"] Jun 10 20:52:29.688563 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.688334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghh7\" (UniqueName: \"kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.688563 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.688473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.689498 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.689366 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:29.691581 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.691553 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:29.693766 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.693743 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:29.696159 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:29.696129 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:29.789485 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.789457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbcps\" (UniqueName: \"kubernetes.io/projected/10f47bea-4452-47cb-b257-c69c1aba248f-kube-api-access-nbcps\") pod \"limitador-operator-controller-manager-859d7b78bd-92gl2\" (UID: \"10f47bea-4452-47cb-b257-c69c1aba248f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:29.789646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.789495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.789646 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.789526 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rghh7\" (UniqueName: \"kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.789929 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.789902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.798518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.798494 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghh7\" (UniqueName: \"kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9dlg8\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:29.890277 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.890171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbcps\" (UniqueName: \"kubernetes.io/projected/10f47bea-4452-47cb-b257-c69c1aba248f-kube-api-access-nbcps\") pod \"limitador-operator-controller-manager-859d7b78bd-92gl2\" (UID: \"10f47bea-4452-47cb-b257-c69c1aba248f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:29.900892 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:29.900847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbcps\" (UniqueName: \"kubernetes.io/projected/10f47bea-4452-47cb-b257-c69c1aba248f-kube-api-access-nbcps\") pod \"limitador-operator-controller-manager-859d7b78bd-92gl2\" (UID: \"10f47bea-4452-47cb-b257-c69c1aba248f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:30.048298 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:30.048260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:30.055818 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:30.055789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:31.979003 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:31.978955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:32.078670 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:32.078632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:35.177406 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:35.177359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:35.274267 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:35.274158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:38.805420 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:38.805374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:38.863287 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:38.863187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:43.934421 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:43.934379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:43.951919 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:43.951896 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2"] Jun 10 20:52:43.984288 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:43.984237 2578 generic.go:356] "Generic (PLEG): container finished" podID="9f47d5f3-8441-45b5-b1a3-7383515cb468" containerID="078470e377430d2c8978607cce23ef0dfce2bcd6a9d67a4862b99f28fb486798" exitCode=0 Jun 10 20:52:43.985860 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:43.985835 2578 generic.go:356] "Generic (PLEG): container finished" podID="1635304f-7d73-4eb0-9f1e-15343493bb33" containerID="cfa490336bdba73446f66199f197265cd2da2d75ea5f6fd01ea0792be81bc32e" exitCode=0 Jun 10 20:52:44.071354 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:44.071305 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0318caec_1f5f_4f6e_ae7b_9e5a76c36a09.slice/crio-36dd5f3377f779498c95826189ee4964e9b5e13ab55679ddde6b9b81c9cef30c WatchSource:0}: Error finding container 36dd5f3377f779498c95826189ee4964e9b5e13ab55679ddde6b9b81c9cef30c: Status 404 returned error can't find the container with id 36dd5f3377f779498c95826189ee4964e9b5e13ab55679ddde6b9b81c9cef30c Jun 10 20:52:44.071723 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:44.071698 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f47bea_4452_47cb_b257_c69c1aba248f.slice/crio-a68725200c5744fe57c784200e4cbc129580afa5e22713d138e69a1881d06ed8 WatchSource:0}: Error finding container a68725200c5744fe57c784200e4cbc129580afa5e22713d138e69a1881d06ed8: Status 404 returned error can't find the container with id a68725200c5744fe57c784200e4cbc129580afa5e22713d138e69a1881d06ed8 Jun 10 20:52:44.105424 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.105401 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:44.107719 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:44.107693 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:44.127800 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.127784 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:44.130467 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:44.130340 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:44.132335 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:44.132309 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:44.226511 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.226489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume\") pod \"9f47d5f3-8441-45b5-b1a3-7383515cb468\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " Jun 10 20:52:44.226635 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.226539 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s42gj\" (UniqueName: \"kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj\") pod \"9f47d5f3-8441-45b5-b1a3-7383515cb468\" (UID: \"9f47d5f3-8441-45b5-b1a3-7383515cb468\") " Jun 10 20:52:44.226635 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.226596 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb8wh\" (UniqueName: \"kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh\") pod \"1635304f-7d73-4eb0-9f1e-15343493bb33\" (UID: \"1635304f-7d73-4eb0-9f1e-15343493bb33\") " Jun 10 20:52:44.227002 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.226976 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f47d5f3-8441-45b5-b1a3-7383515cb468" (UID: "9f47d5f3-8441-45b5-b1a3-7383515cb468"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:52:44.228389 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.228366 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj" (OuterVolumeSpecName: "kube-api-access-s42gj") pod "9f47d5f3-8441-45b5-b1a3-7383515cb468" (UID: "9f47d5f3-8441-45b5-b1a3-7383515cb468"). InnerVolumeSpecName "kube-api-access-s42gj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:44.228453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.228425 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh" (OuterVolumeSpecName: "kube-api-access-jb8wh") pod "1635304f-7d73-4eb0-9f1e-15343493bb33" (UID: "1635304f-7d73-4eb0-9f1e-15343493bb33"). InnerVolumeSpecName "kube-api-access-jb8wh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:44.327847 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.327766 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f47d5f3-8441-45b5-b1a3-7383515cb468-extensions-socket-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:52:44.327847 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.327798 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s42gj\" (UniqueName: \"kubernetes.io/projected/9f47d5f3-8441-45b5-b1a3-7383515cb468-kube-api-access-s42gj\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:52:44.327847 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.327812 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb8wh\" (UniqueName: \"kubernetes.io/projected/1635304f-7d73-4eb0-9f1e-15343493bb33-kube-api-access-jb8wh\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:52:44.991344 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.991270 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:44.993145 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.993112 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" event={"ID":"10f47bea-4452-47cb-b257-c69c1aba248f","Type":"ContainerStarted","Data":"f4c1e86737f81ab893c2209f04d30339633bf008668ff6d88c135770bc4d9c19"} Jun 10 20:52:44.993302 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.993170 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:44.993302 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.993195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" event={"ID":"10f47bea-4452-47cb-b257-c69c1aba248f","Type":"ContainerStarted","Data":"a68725200c5744fe57c784200e4cbc129580afa5e22713d138e69a1881d06ed8"} Jun 10 20:52:44.994432 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.994405 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:44.994432 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.994418 2578 scope.go:117] "RemoveContainer" containerID="078470e377430d2c8978607cce23ef0dfce2bcd6a9d67a4862b99f28fb486798" Jun 10 20:52:44.995476 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:44.995351 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:44.996002 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.995987 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:44.997686 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.997658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" event={"ID":"36212c9a-e0bf-4e4c-9482-c8557a930174","Type":"ContainerStarted","Data":"5faa0d04d52f1095e33b0fb8b0b3e30fc5634c0eb8ee556ed5517243348da7dd"} Jun 10 20:52:44.999657 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.999631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" event={"ID":"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09","Type":"ContainerStarted","Data":"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588"} Jun 10 20:52:44.999750 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.999679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" event={"ID":"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09","Type":"ContainerStarted","Data":"36dd5f3377f779498c95826189ee4964e9b5e13ab55679ddde6b9b81c9cef30c"} Jun 10 20:52:44.999750 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:44.999725 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:45.004157 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.004092 2578 scope.go:117] "RemoveContainer" containerID="cfa490336bdba73446f66199f197265cd2da2d75ea5f6fd01ea0792be81bc32e" Jun 10 20:52:45.010864 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.010825 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" podStartSLOduration=16.010814923 podStartE2EDuration="16.010814923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:45.010316381 +0000 UTC m=+647.991025857" watchObservedRunningTime="2026-06-10 20:52:45.010814923 +0000 UTC m=+647.991524384" Jun 10 20:52:45.012371 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:45.012340 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:45.014509 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:45.014487 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:45.016378 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:45.016361 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:45.036055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.036014 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" podStartSLOduration=16.035999512 podStartE2EDuration="16.035999512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:45.035149738 +0000 UTC m=+648.015859191" watchObservedRunningTime="2026-06-10 20:52:45.035999512 +0000 UTC m=+648.016709006" Jun 10 20:52:45.057378 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.057331 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w4rj7" podStartSLOduration=1.5430678150000001 podStartE2EDuration="26.0573186s" totalImagesPullingTime="24.514250785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:45.056876932 +0000 UTC m=+648.037586397" watchObservedRunningTime="2026-06-10 20:52:45.0573186 +0000 UTC m=+648.038028060" Jun 10 20:52:45.333387 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.333315 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 20:52:45.336768 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.336750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.347681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.347659 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 20:52:45.374718 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:45.374682 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-282m4\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-282m4" Jun 10 20:52:45.376949 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:45.376926 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7j49f\" is forbidden: User \"system:node:ip-10-0-142-242.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-242.ec2.internal' and this object" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7j49f" Jun 10 20:52:45.437540 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.437506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95gs5\" (UniqueName: \"kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.437681 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.437546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.455056 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.455032 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1635304f-7d73-4eb0-9f1e-15343493bb33" path="/var/lib/kubelet/pods/1635304f-7d73-4eb0-9f1e-15343493bb33/volumes" Jun 10 20:52:45.455430 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.455415 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f47d5f3-8441-45b5-b1a3-7383515cb468" path="/var/lib/kubelet/pods/9f47d5f3-8441-45b5-b1a3-7383515cb468/volumes" Jun 10 20:52:45.538828 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.538784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95gs5\" (UniqueName: \"kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.538924 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.538837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.539343 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.539325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.547268 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.547215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95gs5\" (UniqueName: \"kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5\") pod \"kuadrant-operator-controller-manager-86878c769f-25znr\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.646896 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.646819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:45.789070 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:45.789041 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 20:52:45.792261 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:52:45.792216 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c160c9b_5234_412f_bcfa_7a9fc8cf3bb9.slice/crio-58b7b2cb2a17239c210f4f0c02241a6784aa2a5bb52d959622d2089ae454e8f0 WatchSource:0}: Error finding container 58b7b2cb2a17239c210f4f0c02241a6784aa2a5bb52d959622d2089ae454e8f0: Status 404 returned error can't find the container with id 58b7b2cb2a17239c210f4f0c02241a6784aa2a5bb52d959622d2089ae454e8f0 Jun 10 20:52:46.007343 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.007294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" event={"ID":"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9","Type":"ContainerStarted","Data":"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923"} Jun 10 20:52:46.007794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.007506 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" podUID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" containerName="manager" containerID="cri-o://9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588" gracePeriod=10 Jun 10 20:52:46.007794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.007601 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:52:46.007794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.007657 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" event={"ID":"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9","Type":"ContainerStarted","Data":"58b7b2cb2a17239c210f4f0c02241a6784aa2a5bb52d959622d2089ae454e8f0"} Jun 10 20:52:46.024901 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.024854 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" podStartSLOduration=1.024840925 podStartE2EDuration="1.024840925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:52:46.023903864 +0000 UTC m=+649.004613326" watchObservedRunningTime="2026-06-10 20:52:46.024840925 +0000 UTC m=+649.005550385" Jun 10 20:52:46.258080 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.258020 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:46.345498 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.345466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume\") pod \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " Jun 10 20:52:46.345678 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.345534 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rghh7\" (UniqueName: \"kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7\") pod \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\" (UID: \"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09\") " Jun 10 20:52:46.345946 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.345920 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" (UID: "0318caec-1f5f-4f6e-ae7b-9e5a76c36a09"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 20:52:46.347622 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.347599 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7" (OuterVolumeSpecName: "kube-api-access-rghh7") pod "0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" (UID: "0318caec-1f5f-4f6e-ae7b-9e5a76c36a09"). InnerVolumeSpecName "kube-api-access-rghh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:52:46.447123 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.447091 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-extensions-socket-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:52:46.447123 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:46.447119 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rghh7\" (UniqueName: \"kubernetes.io/projected/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09-kube-api-access-rghh7\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:52:47.013870 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.013791 2578 generic.go:356] "Generic (PLEG): container finished" podID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" containerID="9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588" exitCode=0 Jun 10 20:52:47.013870 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.013839 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" Jun 10 20:52:47.014311 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.013877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" event={"ID":"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09","Type":"ContainerDied","Data":"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588"} Jun 10 20:52:47.014311 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.013933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8" event={"ID":"0318caec-1f5f-4f6e-ae7b-9e5a76c36a09","Type":"ContainerDied","Data":"36dd5f3377f779498c95826189ee4964e9b5e13ab55679ddde6b9b81c9cef30c"} Jun 10 20:52:47.014311 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.013962 2578 scope.go:117] "RemoveContainer" containerID="9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588" Jun 10 20:52:47.023030 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.023013 2578 scope.go:117] "RemoveContainer" containerID="9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588" Jun 10 20:52:47.023330 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:52:47.023312 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588\": container with ID starting with 9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588 not found: ID does not exist" containerID="9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588" Jun 10 20:52:47.023384 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.023338 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588"} err="failed to get container status \"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588\": rpc error: code = NotFound desc = could not find container \"9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588\": container with ID starting with 9475fc9b54ef1f1f240799110705449db214394626b98468ff135881e4e0b588 not found: ID does not exist" Jun 10 20:52:47.039753 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.039709 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:47.042035 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.042005 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9dlg8"] Jun 10 20:52:47.455745 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.455714 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" path="/var/lib/kubelet/pods/0318caec-1f5f-4f6e-ae7b-9e5a76c36a09/volumes" Jun 10 20:52:47.801867 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.801786 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:47.900178 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:47.900146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:52:56.010179 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:56.010150 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92gl2" Jun 10 20:52:57.016783 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:52:57.016749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 20:53:01.317325 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.317261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:01.322335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.319422 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr"] Jun 10 20:53:01.322335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.320280 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" containerName="manager" Jun 10 20:53:01.322335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.320299 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" containerName="manager" Jun 10 20:53:01.322335 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.320532 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0318caec-1f5f-4f6e-ae7b-9e5a76c36a09" containerName="manager" Jun 10 20:53:01.328872 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.328849 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.332359 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.332334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xlrpx\"" Jun 10 20:53:01.337228 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.337200 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr"] Jun 10 20:53:01.374281 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.374227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:01.480798 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.480754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a22c0f-f733-4a32-a2b7-91cf997e4755-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.480993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.480803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.480993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.480858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5km5q\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-kube-api-access-5km5q\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.480993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.480887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.480993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.480988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.481196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.481022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.481196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.481046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.481196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.481073 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.481196 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.481120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a22c0f-f733-4a32-a2b7-91cf997e4755-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5km5q\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-kube-api-access-5km5q\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.582712 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.582662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.583038 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.583014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82a22c0f-f733-4a32-a2b7-91cf997e4755-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.583120 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.583073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.583183 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.583128 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.583266 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.583187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.583406 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.583368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.584924 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.584907 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.585127 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.585111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.591495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.591463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.591634 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.591584 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5km5q\" (UniqueName: \"kubernetes.io/projected/82a22c0f-f733-4a32-a2b7-91cf997e4755-kube-api-access-5km5q\") pod \"maas-default-gateway-openshift-default-687ff6996-6bplr\" (UID: \"82a22c0f-f733-4a32-a2b7-91cf997e4755\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.642418 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.642378 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:01.696061 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.696026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:01.789035 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.789009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr"] Jun 10 20:53:01.791807 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:53:01.791779 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a22c0f_f733_4a32_a2b7_91cf997e4755.slice/crio-bf1a43363dd0aa8adc024ec4eb4af0d6912705ef71172e8d7a7e174810d16dfc WatchSource:0}: Error finding container bf1a43363dd0aa8adc024ec4eb4af0d6912705ef71172e8d7a7e174810d16dfc: Status 404 returned error can't find the container with id bf1a43363dd0aa8adc024ec4eb4af0d6912705ef71172e8d7a7e174810d16dfc Jun 10 20:53:01.794381 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.794348 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:53:01.794477 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.794413 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:53:01.794477 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.794463 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:53:01.809376 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:01.809335 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:02.089760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:02.089672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" event={"ID":"82a22c0f-f733-4a32-a2b7-91cf997e4755","Type":"ContainerStarted","Data":"fdaa023fa95efc639cba91e470679960e8c86612a2c852ced214d2218dbd86f9"} Jun 10 20:53:02.089760 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:02.089728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" event={"ID":"82a22c0f-f733-4a32-a2b7-91cf997e4755","Type":"ContainerStarted","Data":"bf1a43363dd0aa8adc024ec4eb4af0d6912705ef71172e8d7a7e174810d16dfc"} Jun 10 20:53:02.110761 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:02.110694 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" podStartSLOduration=1.110676226 podStartE2EDuration="1.110676226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:02.110377346 +0000 UTC m=+665.091086823" watchObservedRunningTime="2026-06-10 20:53:02.110676226 +0000 UTC m=+665.091385689" Jun 10 20:53:02.642726 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:02.642697 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:02.647334 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:02.647313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:03.094306 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:03.094279 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:03.095350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:03.095329 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:53:13.791160 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:13.791118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:13.888998 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:13.888965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:13.989501 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:13.989467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:14.618057 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.618003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:14.692660 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.692631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:14.697299 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.697272 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:53:14.737590 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.737560 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:53:14.737746 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.737651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:53:14.742292 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.742272 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r9jp8\"" Jun 10 20:53:14.791531 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.791499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxln\" (UniqueName: \"kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln\") pod \"authorino-75d556bd77-m5cqd\" (UID: \"87dfce27-671b-4621-bb44-7c473a659171\") " pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:53:14.892208 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.892124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxln\" (UniqueName: \"kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln\") pod \"authorino-75d556bd77-m5cqd\" (UID: \"87dfce27-671b-4621-bb44-7c473a659171\") " pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:53:14.901070 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:14.901048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxln\" (UniqueName: \"kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln\") pod \"authorino-75d556bd77-m5cqd\" (UID: \"87dfce27-671b-4621-bb44-7c473a659171\") " pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:53:15.046886 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:15.046853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:53:15.176571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:15.176547 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:53:15.179103 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:53:15.179071 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87dfce27_671b_4621_bb44_7c473a659171.slice/crio-469c71dc5f907f8d83536eeda9f710b65b7d05267d84831f8efa41c7a1739369 WatchSource:0}: Error finding container 469c71dc5f907f8d83536eeda9f710b65b7d05267d84831f8efa41c7a1739369: Status 404 returned error can't find the container with id 469c71dc5f907f8d83536eeda9f710b65b7d05267d84831f8efa41c7a1739369 Jun 10 20:53:16.166297 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:16.166225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5cqd" event={"ID":"87dfce27-671b-4621-bb44-7c473a659171","Type":"ContainerStarted","Data":"469c71dc5f907f8d83536eeda9f710b65b7d05267d84831f8efa41c7a1739369"} Jun 10 20:53:19.182372 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:19.182336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5cqd" event={"ID":"87dfce27-671b-4621-bb44-7c473a659171","Type":"ContainerStarted","Data":"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e"} Jun 10 20:53:19.198044 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:19.197996 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-m5cqd" podStartSLOduration=2.140373221 podStartE2EDuration="5.19798261s" totalImagesPullingTime="3.057609389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:53:19.197637828 +0000 UTC m=+682.178347294" watchObservedRunningTime="2026-06-10 20:53:19.19798261 +0000 UTC m=+682.178692068" Jun 10 20:53:34.549926 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:34.549888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:43.617569 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:43.617533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:43.717255 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:43.717209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:53:43.853252 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:53:43.853220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:06.784737 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:06.784705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:06.838744 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:06.838713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:07.199124 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.199092 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:54:07.204451 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.204431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:07.207251 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.207221 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 20:54:07.207402 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.207381 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 20:54:07.207467 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.207407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hrf5p\"" Jun 10 20:54:07.207467 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.207409 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 20:54:07.212557 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.212538 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:54:07.251008 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.250982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdgh\" (UniqueName: \"kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh\") pod \"maas-keycloak-0\" (UID: \"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:07.351573 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.351547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdgh\" (UniqueName: \"kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh\") pod \"maas-keycloak-0\" (UID: \"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:07.360070 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.360049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdgh\" (UniqueName: \"kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh\") pod \"maas-keycloak-0\" (UID: \"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:07.515408 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.515336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:07.648877 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:07.648855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:54:07.651469 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:54:07.651435 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7d6472_0fd2_4a6f_b0f3_e6ba912f3124.slice/crio-af629c1b095de26f7606e0390fb6acd9ba11908af2748821803bb371313adf55 WatchSource:0}: Error finding container af629c1b095de26f7606e0390fb6acd9ba11908af2748821803bb371313adf55: Status 404 returned error can't find the container with id af629c1b095de26f7606e0390fb6acd9ba11908af2748821803bb371313adf55 Jun 10 20:54:08.413571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:08.413531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124","Type":"ContainerStarted","Data":"af629c1b095de26f7606e0390fb6acd9ba11908af2748821803bb371313adf55"} Jun 10 20:54:14.449507 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:14.449467 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124","Type":"ContainerStarted","Data":"c4db141feb72a0fa423d823d41b126f3d23fa45dd48bc4e03859e3d3c60872ea"} Jun 10 20:54:14.469384 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:14.469312 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.226672409 podStartE2EDuration="7.469292117s" totalImagesPullingTime="6.242619708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:54:14.466670178 +0000 UTC m=+737.447379635" watchObservedRunningTime="2026-06-10 20:54:14.469292117 +0000 UTC m=+737.450001579" Jun 10 20:54:14.515974 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:14.515935 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:14.517572 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:14.517541 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:15.516656 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:15.516601 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:16.515882 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:16.515837 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:17.515935 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:17.515888 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:17.516454 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:17.516149 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:18.516620 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:18.516572 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:19.516157 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:19.516104 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:20.516138 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:20.516092 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:21.515930 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:21.515879 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:22.516594 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:22.516555 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:23.516031 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:23.515986 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:24.516174 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:24.516117 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:25.515675 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:25.515633 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:26.515925 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:26.515885 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.35:9000/health/started\": dial tcp 10.133.0.35:9000: connect: connection refused" Jun 10 20:54:27.646466 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:27.646431 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:27.664100 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:27.664035 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:54:37.653037 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:37.653004 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:54:38.303683 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:38.303642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:38.594639 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:38.594556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:40.148761 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.148725 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:54:40.149145 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.148959 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-m5cqd" podUID="87dfce27-671b-4621-bb44-7c473a659171" containerName="authorino" containerID="cri-o://aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e" gracePeriod=30 Jun 10 20:54:40.400607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.400552 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:54:40.482444 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.482415 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxln\" (UniqueName: \"kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln\") pod \"87dfce27-671b-4621-bb44-7c473a659171\" (UID: \"87dfce27-671b-4621-bb44-7c473a659171\") " Jun 10 20:54:40.484412 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.484383 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln" (OuterVolumeSpecName: "kube-api-access-pzxln") pod "87dfce27-671b-4621-bb44-7c473a659171" (UID: "87dfce27-671b-4621-bb44-7c473a659171"). InnerVolumeSpecName "kube-api-access-pzxln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:54:40.583215 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.583178 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxln\" (UniqueName: \"kubernetes.io/projected/87dfce27-671b-4621-bb44-7c473a659171-kube-api-access-pzxln\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:54:40.623885 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.623853 2578 generic.go:356] "Generic (PLEG): container finished" podID="87dfce27-671b-4621-bb44-7c473a659171" containerID="aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e" exitCode=0 Jun 10 20:54:40.623885 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.623885 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5cqd" Jun 10 20:54:40.624060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.623926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5cqd" event={"ID":"87dfce27-671b-4621-bb44-7c473a659171","Type":"ContainerDied","Data":"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e"} Jun 10 20:54:40.624060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.623964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5cqd" event={"ID":"87dfce27-671b-4621-bb44-7c473a659171","Type":"ContainerDied","Data":"469c71dc5f907f8d83536eeda9f710b65b7d05267d84831f8efa41c7a1739369"} Jun 10 20:54:40.624060 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.623984 2578 scope.go:117] "RemoveContainer" containerID="aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e" Jun 10 20:54:40.633295 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.633279 2578 scope.go:117] "RemoveContainer" containerID="aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e" Jun 10 20:54:40.633544 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:54:40.633525 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e\": container with ID starting with aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e not found: ID does not exist" containerID="aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e" Jun 10 20:54:40.633593 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.633553 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e"} err="failed to get container status \"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e\": rpc error: code = NotFound desc = could not find container \"aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e\": container with ID starting with aa479be97024975da7bdef9d361870914a995996f4e1cf80887427d9cda6345e not found: ID does not exist" Jun 10 20:54:40.645303 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.645278 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:54:40.648895 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:40.648876 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5cqd"] Jun 10 20:54:41.455735 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:41.455699 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87dfce27-671b-4621-bb44-7c473a659171" path="/var/lib/kubelet/pods/87dfce27-671b-4621-bb44-7c473a659171/volumes" Jun 10 20:54:43.676045 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.676005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:43.694145 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.694116 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:54:43.694486 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.694474 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dfce27-671b-4621-bb44-7c473a659171" containerName="authorino" Jun 10 20:54:43.694533 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.694487 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dfce27-671b-4621-bb44-7c473a659171" containerName="authorino" Jun 10 20:54:43.694568 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.694548 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87dfce27-671b-4621-bb44-7c473a659171" containerName="authorino" Jun 10 20:54:43.697506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.697491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.700446 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.700424 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 20:54:43.700566 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.700430 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fsq8p\"" Jun 10 20:54:43.700566 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.700434 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 20:54:43.706477 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.706454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:54:43.709313 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.709292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tj79\" (UniqueName: \"kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.709452 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.709323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.773332 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.773298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:43.810384 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.810355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tj79\" (UniqueName: \"kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.810511 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.810389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.812736 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.812709 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.819849 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.819821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tj79\" (UniqueName: \"kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79\") pod \"maas-controller-555d46776c-7v289\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:43.828900 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.828876 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:43.872055 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.872021 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 20:54:43.875452 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.875435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:43.886378 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.886358 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 20:54:43.911310 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.911282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:43.911405 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:43.911314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjzwj\" (UniqueName: \"kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.007383 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.007352 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:44.012567 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.012546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.012692 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.012581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjzwj\" (UniqueName: \"kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.014748 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.014730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.020961 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.020940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjzwj\" (UniqueName: \"kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj\") pod \"maas-controller-777875845c-x2t8z\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.139115 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.139089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:54:44.141534 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:54:44.141495 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800d48da_20e3_4d08_be05_6246d1ac2ee4.slice/crio-15b348f9db5edbe229b87ad6ccb4ef4b86f70ef81eca832530867b657f1b24c9 WatchSource:0}: Error finding container 15b348f9db5edbe229b87ad6ccb4ef4b86f70ef81eca832530867b657f1b24c9: Status 404 returned error can't find the container with id 15b348f9db5edbe229b87ad6ccb4ef4b86f70ef81eca832530867b657f1b24c9 Jun 10 20:54:44.186644 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.186619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:44.315375 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.315343 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 20:54:44.318506 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:54:44.318480 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c9c9a0_0a3d_4b1b_9f7e_718a03773043.slice/crio-5b4f0a53a51429e39a8515780d4a80fd3923ce6dcdf51048f3e8aba67049c7cc WatchSource:0}: Error finding container 5b4f0a53a51429e39a8515780d4a80fd3923ce6dcdf51048f3e8aba67049c7cc: Status 404 returned error can't find the container with id 5b4f0a53a51429e39a8515780d4a80fd3923ce6dcdf51048f3e8aba67049c7cc Jun 10 20:54:44.644366 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.644275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555d46776c-7v289" event={"ID":"800d48da-20e3-4d08-be05-6246d1ac2ee4","Type":"ContainerStarted","Data":"15b348f9db5edbe229b87ad6ccb4ef4b86f70ef81eca832530867b657f1b24c9"} Jun 10 20:54:44.645491 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:44.645458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-x2t8z" event={"ID":"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043","Type":"ContainerStarted","Data":"5b4f0a53a51429e39a8515780d4a80fd3923ce6dcdf51048f3e8aba67049c7cc"} Jun 10 20:54:47.012397 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.012362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:47.113043 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.112950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:54:47.665840 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.665810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555d46776c-7v289" event={"ID":"800d48da-20e3-4d08-be05-6246d1ac2ee4","Type":"ContainerStarted","Data":"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd"} Jun 10 20:54:47.666029 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.665890 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:47.667374 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.667351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-x2t8z" event={"ID":"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043","Type":"ContainerStarted","Data":"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5"} Jun 10 20:54:47.667512 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.667465 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:47.684445 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.684400 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-555d46776c-7v289" podStartSLOduration=2.048671282 podStartE2EDuration="4.684386856s" totalImagesPullingTime="2.635715574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:54:47.683678231 +0000 UTC m=+770.664387693" watchObservedRunningTime="2026-06-10 20:54:47.684386856 +0000 UTC m=+770.665096316" Jun 10 20:54:47.702518 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:47.702473 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-777875845c-x2t8z" podStartSLOduration=2.232981609 podStartE2EDuration="4.702461134s" totalImagesPullingTime="2.469479525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:54:47.701410917 +0000 UTC m=+770.682120380" watchObservedRunningTime="2026-06-10 20:54:47.702461134 +0000 UTC m=+770.683170594" Jun 10 20:54:58.677557 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:58.677520 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:58.677932 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:58.677617 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 20:54:58.739495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:58.739466 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:54:58.739667 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:58.739641 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-555d46776c-7v289" podUID="800d48da-20e3-4d08-be05-6246d1ac2ee4" containerName="manager" containerID="cri-o://732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd" gracePeriod=30 Jun 10 20:54:58.987866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:58.987837 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:59.054226 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.054197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert\") pod \"800d48da-20e3-4d08-be05-6246d1ac2ee4\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " Jun 10 20:54:59.054396 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.054305 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tj79\" (UniqueName: \"kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79\") pod \"800d48da-20e3-4d08-be05-6246d1ac2ee4\" (UID: \"800d48da-20e3-4d08-be05-6246d1ac2ee4\") " Jun 10 20:54:59.056370 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.056331 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79" (OuterVolumeSpecName: "kube-api-access-8tj79") pod "800d48da-20e3-4d08-be05-6246d1ac2ee4" (UID: "800d48da-20e3-4d08-be05-6246d1ac2ee4"). InnerVolumeSpecName "kube-api-access-8tj79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:54:59.056481 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.056383 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "800d48da-20e3-4d08-be05-6246d1ac2ee4" (UID: "800d48da-20e3-4d08-be05-6246d1ac2ee4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 20:54:59.154906 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.154876 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tj79\" (UniqueName: \"kubernetes.io/projected/800d48da-20e3-4d08-be05-6246d1ac2ee4-kube-api-access-8tj79\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:54:59.154906 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.154902 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800d48da-20e3-4d08-be05-6246d1ac2ee4-webhook-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:54:59.725936 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.725852 2578 generic.go:356] "Generic (PLEG): container finished" podID="800d48da-20e3-4d08-be05-6246d1ac2ee4" containerID="732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd" exitCode=0 Jun 10 20:54:59.725936 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.725893 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-555d46776c-7v289" Jun 10 20:54:59.726362 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.725940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555d46776c-7v289" event={"ID":"800d48da-20e3-4d08-be05-6246d1ac2ee4","Type":"ContainerDied","Data":"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd"} Jun 10 20:54:59.726362 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.725987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-555d46776c-7v289" event={"ID":"800d48da-20e3-4d08-be05-6246d1ac2ee4","Type":"ContainerDied","Data":"15b348f9db5edbe229b87ad6ccb4ef4b86f70ef81eca832530867b657f1b24c9"} Jun 10 20:54:59.726362 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.726010 2578 scope.go:117] "RemoveContainer" containerID="732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd" Jun 10 20:54:59.734396 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.734381 2578 scope.go:117] "RemoveContainer" containerID="732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd" Jun 10 20:54:59.734628 ip-10-0-142-242 kubenswrapper[2578]: E0610 20:54:59.734611 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd\": container with ID starting with 732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd not found: ID does not exist" containerID="732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd" Jun 10 20:54:59.734671 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.734637 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd"} err="failed to get container status \"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd\": rpc error: code = NotFound desc = could not find container \"732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd\": container with ID starting with 732dc637e07d40b8756d5a3ce442769e1d2f51d15a891197a03dfd5e74ed6edd not found: ID does not exist" Jun 10 20:54:59.742724 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.742700 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:54:59.746350 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:54:59.746330 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-555d46776c-7v289"] Jun 10 20:55:01.456023 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:01.455992 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800d48da-20e3-4d08-be05-6246d1ac2ee4" path="/var/lib/kubelet/pods/800d48da-20e3-4d08-be05-6246d1ac2ee4/volumes" Jun 10 20:55:17.847979 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.847901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:55:17.905106 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.905074 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7fbfc7958b-vwgv4"] Jun 10 20:55:17.905446 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.905434 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800d48da-20e3-4d08-be05-6246d1ac2ee4" containerName="manager" Jun 10 20:55:17.905498 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.905448 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="800d48da-20e3-4d08-be05-6246d1ac2ee4" containerName="manager" Jun 10 20:55:17.905534 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.905522 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="800d48da-20e3-4d08-be05-6246d1ac2ee4" containerName="manager" Jun 10 20:55:17.907605 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.907589 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:17.910560 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.910541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 20:55:17.910696 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.910592 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdrst\"" Jun 10 20:55:17.917170 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:17.917140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbfc7958b-vwgv4"] Jun 10 20:55:18.015917 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.015884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff61801b-820a-454c-aec7-1595fea71d60-openshift-service-ca\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.015917 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.015921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jv9j\" (UniqueName: \"kubernetes.io/projected/ff61801b-820a-454c-aec7-1595fea71d60-kube-api-access-2jv9j\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.016146 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.015955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff61801b-820a-454c-aec7-1595fea71d60-maas-api-tls\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.116757 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.116668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff61801b-820a-454c-aec7-1595fea71d60-openshift-service-ca\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.116757 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.116720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jv9j\" (UniqueName: \"kubernetes.io/projected/ff61801b-820a-454c-aec7-1595fea71d60-kube-api-access-2jv9j\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.116757 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.116750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff61801b-820a-454c-aec7-1595fea71d60-maas-api-tls\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.117454 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.117420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff61801b-820a-454c-aec7-1595fea71d60-openshift-service-ca\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.119690 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.119669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff61801b-820a-454c-aec7-1595fea71d60-maas-api-tls\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.124735 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.124706 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jv9j\" (UniqueName: \"kubernetes.io/projected/ff61801b-820a-454c-aec7-1595fea71d60-kube-api-access-2jv9j\") pod \"maas-api-7fbfc7958b-vwgv4\" (UID: \"ff61801b-820a-454c-aec7-1595fea71d60\") " pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.133742 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.133712 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:55:18.217930 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.217900 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:18.262971 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.262939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:55:18.356705 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.356674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbfc7958b-vwgv4"] Jun 10 20:55:18.358743 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:55:18.358712 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff61801b_820a_454c_aec7_1595fea71d60.slice/crio-1a39ccc6bb51ec0c6e1e08cfeb8334c0cfbc36355f6aa7a70606f093ae6e9d15 WatchSource:0}: Error finding container 1a39ccc6bb51ec0c6e1e08cfeb8334c0cfbc36355f6aa7a70606f093ae6e9d15: Status 404 returned error can't find the container with id 1a39ccc6bb51ec0c6e1e08cfeb8334c0cfbc36355f6aa7a70606f093ae6e9d15 Jun 10 20:55:18.359016 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.358981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:55:18.360194 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.360173 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 20:55:18.365600 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.365576 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-6625p"] Jun 10 20:55:18.368993 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.368947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:18.371528 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.371511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 20:55:18.371745 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.371730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v57kb\"" Jun 10 20:55:18.378751 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.378717 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-6625p"] Jun 10 20:55:18.399065 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.399041 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9d9pq"] Jun 10 20:55:18.401475 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.401459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:18.412046 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.412026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9d9pq"] Jun 10 20:55:18.520434 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.520397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kklp4\" (UniqueName: \"kubernetes.io/projected/d7e03ae0-b797-45e0-bf9a-c5b7c15db900-kube-api-access-kklp4\") pod \"payload-pre-processing-579785bc64-6625p\" (UID: \"d7e03ae0-b797-45e0-bf9a-c5b7c15db900\") " pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:18.520602 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.520442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcxfc\" (UniqueName: \"kubernetes.io/projected/e3343b60-d8cc-4b0b-b4b3-645ab315a41d-kube-api-access-lcxfc\") pod \"payload-processing-699b6cd6c-9d9pq\" (UID: \"e3343b60-d8cc-4b0b-b4b3-645ab315a41d\") " pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:18.621954 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.621869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kklp4\" (UniqueName: \"kubernetes.io/projected/d7e03ae0-b797-45e0-bf9a-c5b7c15db900-kube-api-access-kklp4\") pod \"payload-pre-processing-579785bc64-6625p\" (UID: \"d7e03ae0-b797-45e0-bf9a-c5b7c15db900\") " pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:18.621954 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.621911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcxfc\" (UniqueName: \"kubernetes.io/projected/e3343b60-d8cc-4b0b-b4b3-645ab315a41d-kube-api-access-lcxfc\") pod \"payload-processing-699b6cd6c-9d9pq\" (UID: \"e3343b60-d8cc-4b0b-b4b3-645ab315a41d\") " pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:18.629755 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.629732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kklp4\" (UniqueName: \"kubernetes.io/projected/d7e03ae0-b797-45e0-bf9a-c5b7c15db900-kube-api-access-kklp4\") pod \"payload-pre-processing-579785bc64-6625p\" (UID: \"d7e03ae0-b797-45e0-bf9a-c5b7c15db900\") " pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:18.629868 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.629739 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcxfc\" (UniqueName: \"kubernetes.io/projected/e3343b60-d8cc-4b0b-b4b3-645ab315a41d-kube-api-access-lcxfc\") pod \"payload-processing-699b6cd6c-9d9pq\" (UID: \"e3343b60-d8cc-4b0b-b4b3-645ab315a41d\") " pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:18.680390 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.680364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:18.711558 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.711532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:18.824825 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.824684 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-6625p"] Jun 10 20:55:18.827866 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:55:18.827805 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e03ae0_b797_45e0_bf9a_c5b7c15db900.slice/crio-6358acfa00ee2ff09ead2653c201425aeac94e4a639a9ee4ef6692111768347c WatchSource:0}: Error finding container 6358acfa00ee2ff09ead2653c201425aeac94e4a639a9ee4ef6692111768347c: Status 404 returned error can't find the container with id 6358acfa00ee2ff09ead2653c201425aeac94e4a639a9ee4ef6692111768347c Jun 10 20:55:18.829476 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.829412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" event={"ID":"ff61801b-820a-454c-aec7-1595fea71d60","Type":"ContainerStarted","Data":"1a39ccc6bb51ec0c6e1e08cfeb8334c0cfbc36355f6aa7a70606f093ae6e9d15"} Jun 10 20:55:18.859454 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:18.859420 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-9d9pq"] Jun 10 20:55:18.863014 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:55:18.862968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3343b60_d8cc_4b0b_b4b3_645ab315a41d.slice/crio-1b092127e19fdcda84656a88047765a40c16ed9b5d3e9fbb04e3bf6c03f5e5fe WatchSource:0}: Error finding container 1b092127e19fdcda84656a88047765a40c16ed9b5d3e9fbb04e3bf6c03f5e5fe: Status 404 returned error can't find the container with id 1b092127e19fdcda84656a88047765a40c16ed9b5d3e9fbb04e3bf6c03f5e5fe Jun 10 20:55:19.866526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:19.866429 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" event={"ID":"d7e03ae0-b797-45e0-bf9a-c5b7c15db900","Type":"ContainerStarted","Data":"6358acfa00ee2ff09ead2653c201425aeac94e4a639a9ee4ef6692111768347c"} Jun 10 20:55:19.868174 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:19.867977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" event={"ID":"e3343b60-d8cc-4b0b-b4b3-645ab315a41d","Type":"ContainerStarted","Data":"1b092127e19fdcda84656a88047765a40c16ed9b5d3e9fbb04e3bf6c03f5e5fe"} Jun 10 20:55:22.885700 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.885662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" event={"ID":"e3343b60-d8cc-4b0b-b4b3-645ab315a41d","Type":"ContainerStarted","Data":"843e450e0f54e867a91973602b94e322607341103b047c108f29e8c04735a85f"} Jun 10 20:55:22.886193 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.885733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:22.887303 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.887263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" event={"ID":"d7e03ae0-b797-45e0-bf9a-c5b7c15db900","Type":"ContainerStarted","Data":"f4a56e376a765d8b4a07b874aae94463cbf77e669585db44c66291ecde7b2088"} Jun 10 20:55:22.887416 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.887313 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:22.888718 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.888695 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" event={"ID":"ff61801b-820a-454c-aec7-1595fea71d60","Type":"ContainerStarted","Data":"df6336334e4c2f920db517c49e39bbdf5b20eddc24ad8c275ed5db387bb731ac"} Jun 10 20:55:22.888835 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.888821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:22.905015 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.904969 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" podStartSLOduration=1.785721093 podStartE2EDuration="4.904955301s" totalImagesPullingTime="3.119234208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:55:22.902883365 +0000 UTC m=+805.883592826" watchObservedRunningTime="2026-06-10 20:55:22.904955301 +0000 UTC m=+805.885664739" Jun 10 20:55:22.919314 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.919268 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" podStartSLOduration=1.770895881 podStartE2EDuration="4.919236736s" totalImagesPullingTime="3.148340855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:55:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:55:22.918883201 +0000 UTC m=+805.899592663" watchObservedRunningTime="2026-06-10 20:55:22.919236736 +0000 UTC m=+805.899946213" Jun 10 20:55:22.936636 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:22.936583 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" podStartSLOduration=2.385283898 podStartE2EDuration="5.936551161s" totalImagesPullingTime="3.551267263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:55:22.935085078 +0000 UTC m=+805.915794540" watchObservedRunningTime="2026-06-10 20:55:22.936551161 +0000 UTC m=+805.917260625" Jun 10 20:55:26.922443 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.922407 2578 generic.go:356] "Generic (PLEG): container finished" podID="82a22c0f-f733-4a32-a2b7-91cf997e4755" containerID="fdaa023fa95efc639cba91e470679960e8c86612a2c852ced214d2218dbd86f9" exitCode=0 Jun 10 20:55:26.922990 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.922481 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" event={"ID":"82a22c0f-f733-4a32-a2b7-91cf997e4755","Type":"ContainerDied","Data":"fdaa023fa95efc639cba91e470679960e8c86612a2c852ced214d2218dbd86f9"} Jun 10 20:55:26.922990 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.922855 2578 scope.go:117] "RemoveContainer" containerID="fdaa023fa95efc639cba91e470679960e8c86612a2c852ced214d2218dbd86f9" Jun 10 20:55:26.923908 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.923881 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:55:26.923974 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.923946 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:55:26.924010 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:26.923981 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 20:55:27.929292 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:27.929235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" event={"ID":"82a22c0f-f733-4a32-a2b7-91cf997e4755","Type":"ContainerStarted","Data":"45ba3a230a034338f41c90ebdb6bb97194639e41a593b7a815b797d7d453154c"} Jun 10 20:55:28.643282 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:28.643230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:55:28.644489 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:28.644456 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6bplr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 20:55:28.644725 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:28.644697 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" podUID="82a22c0f-f733-4a32-a2b7-91cf997e4755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 20:55:28.907916 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:28.907843 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7fbfc7958b-vwgv4" Jun 10 20:55:29.642985 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:29.642940 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6bplr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 20:55:29.643493 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:29.643031 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" podUID="82a22c0f-f733-4a32-a2b7-91cf997e4755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 20:55:30.643864 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:30.643400 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6bplr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 20:55:30.643864 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:30.643478 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" podUID="82a22c0f-f733-4a32-a2b7-91cf997e4755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 20:55:31.643385 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:31.643347 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-6bplr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jun 10 20:55:31.643702 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:31.643662 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" podUID="82a22c0f-f733-4a32-a2b7-91cf997e4755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jun 10 20:55:32.646648 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:32.646621 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:55:32.647073 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:32.646907 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:55:32.647591 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:32.647573 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-6bplr" Jun 10 20:55:33.904789 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:33.904760 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-9d9pq" Jun 10 20:55:33.905164 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:33.904896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-6625p" Jun 10 20:55:52.973066 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:52.973029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:55:53.073659 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:55:53.073625 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:56:21.064377 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:56:21.064332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:56:21.166027 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:56:21.165994 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:57:31.850451 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:31.850393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:57:33.069951 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:33.069910 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:33.070411 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:33.070163 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" containerID="cri-o://c4db141feb72a0fa423d823d41b126f3d23fa45dd48bc4e03859e3d3c60872ea" gracePeriod=30 Jun 10 20:57:34.555910 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:34.555879 2578 generic.go:356] "Generic (PLEG): container finished" podID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerID="c4db141feb72a0fa423d823d41b126f3d23fa45dd48bc4e03859e3d3c60872ea" exitCode=143 Jun 10 20:57:34.556266 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:34.555954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124","Type":"ContainerDied","Data":"c4db141feb72a0fa423d823d41b126f3d23fa45dd48bc4e03859e3d3c60872ea"} Jun 10 20:57:35.123636 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.123611 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.250465 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.250389 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdgh\" (UniqueName: \"kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh\") pod \"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124\" (UID: \"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124\") " Jun 10 20:57:35.252456 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.252427 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh" (OuterVolumeSpecName: "kube-api-access-cmdgh") pod "2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" (UID: "2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124"). InnerVolumeSpecName "kube-api-access-cmdgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 20:57:35.351792 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.351764 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdgh\" (UniqueName: \"kubernetes.io/projected/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124-kube-api-access-cmdgh\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 20:57:35.568450 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.568372 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.568450 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.568387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124","Type":"ContainerDied","Data":"af629c1b095de26f7606e0390fb6acd9ba11908af2748821803bb371313adf55"} Jun 10 20:57:35.569774 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.568462 2578 scope.go:117] "RemoveContainer" containerID="c4db141feb72a0fa423d823d41b126f3d23fa45dd48bc4e03859e3d3c60872ea" Jun 10 20:57:35.586671 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.586642 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:35.590664 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.590645 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:35.617323 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.617300 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:35.617678 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.617666 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" Jun 10 20:57:35.617720 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.617680 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" Jun 10 20:57:35.617759 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.617736 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" containerName="keycloak" Jun 10 20:57:35.622217 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.622203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.624797 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.624773 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 20:57:35.624896 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.624859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 20:57:35.624979 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.624962 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 20:57:35.625039 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.625019 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-hrf5p\"" Jun 10 20:57:35.625154 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.625139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 20:57:35.632152 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.632134 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:35.755958 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.755924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljsd\" (UniqueName: \"kubernetes.io/projected/21445cd8-1cce-47fd-b702-bcaee90acd86-kube-api-access-4ljsd\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.756135 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.756060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/21445cd8-1cce-47fd-b702-bcaee90acd86-test-realms\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.857083 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.856999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/21445cd8-1cce-47fd-b702-bcaee90acd86-test-realms\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.857083 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.857046 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljsd\" (UniqueName: \"kubernetes.io/projected/21445cd8-1cce-47fd-b702-bcaee90acd86-kube-api-access-4ljsd\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.857765 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.857740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/21445cd8-1cce-47fd-b702-bcaee90acd86-test-realms\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.865833 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.865811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljsd\" (UniqueName: \"kubernetes.io/projected/21445cd8-1cce-47fd-b702-bcaee90acd86-kube-api-access-4ljsd\") pod \"maas-keycloak-0\" (UID: \"21445cd8-1cce-47fd-b702-bcaee90acd86\") " pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:35.933486 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:35.933453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:36.065978 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.065955 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 20:57:36.067933 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:57:36.067906 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21445cd8_1cce_47fd_b702_bcaee90acd86.slice/crio-93bc204859c090bc4b5302a6d22d8053d3d6c2213822a626685a2d04a5498d5e WatchSource:0}: Error finding container 93bc204859c090bc4b5302a6d22d8053d3d6c2213822a626685a2d04a5498d5e: Status 404 returned error can't find the container with id 93bc204859c090bc4b5302a6d22d8053d3d6c2213822a626685a2d04a5498d5e Jun 10 20:57:36.574801 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.574764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21445cd8-1cce-47fd-b702-bcaee90acd86","Type":"ContainerStarted","Data":"3881424cc5406471d10a3ad038fc273ad19c31041752243bdb8a024959e08d2a"} Jun 10 20:57:36.575237 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.574818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"21445cd8-1cce-47fd-b702-bcaee90acd86","Type":"ContainerStarted","Data":"93bc204859c090bc4b5302a6d22d8053d3d6c2213822a626685a2d04a5498d5e"} Jun 10 20:57:36.595822 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.595769 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.240534142 podStartE2EDuration="1.595752489s" totalImagesPullingTime="355.218347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:57:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:57:36.595194482 +0000 UTC m=+939.575903943" watchObservedRunningTime="2026-06-10 20:57:36.595752489 +0000 UTC m=+939.576461990" Jun 10 20:57:36.933971 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.933939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:36.935526 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:36.935494 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:37.459225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:37.459190 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124" path="/var/lib/kubelet/pods/2d7d6472-0fd2-4a6f-b0f3-e6ba912f3124/volumes" Jun 10 20:57:37.934776 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:37.934725 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:38.934318 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:38.934277 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:39.933860 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:39.933817 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:40.934394 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:40.934328 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:41.934773 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:41.934725 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:42.934839 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:42.934796 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:43.934063 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:43.934012 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:44.933832 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:44.933797 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:45.934642 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:45.934600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:45.935127 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:45.934836 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:46.934143 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:46.934091 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:47.934225 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:47.934172 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:48.933875 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:48.933827 2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 10 20:57:50.064835 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:50.064800 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 20:57:50.080842 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:57:50.080798 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="21445cd8-1cce-47fd-b702-bcaee90acd86" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 20:58:00.070195 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:00.070163 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 20:58:12.759085 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:12.759050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:58:12.857096 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:12.857061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:58:30.683299 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:30.683212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:58:30.783866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:30.783836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:58:39.721950 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.721910 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch"] Jun 10 20:58:39.725686 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.725670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.731925 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.731900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ljvbc\"" Jun 10 20:58:39.732203 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.732154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 20:58:39.732351 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.732213 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 20:58:39.733734 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.733704 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 20:58:39.740769 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.740743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch"] Jun 10 20:58:39.762753 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.762722 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:58:39.762877 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.762797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.762877 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.762862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc867aa-15af-4c67-ad76-06b34830d702-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.762962 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.762884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.762962 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.762923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.763044 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.763024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v28f6\" (UniqueName: \"kubernetes.io/projected/fcc867aa-15af-4c67-ad76-06b34830d702-kube-api-access-v28f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.763084 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.763069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864511 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v28f6\" (UniqueName: \"kubernetes.io/projected/fcc867aa-15af-4c67-ad76-06b34830d702-kube-api-access-v28f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864511 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc867aa-15af-4c67-ad76-06b34830d702-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864617 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.864985 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.864965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.865085 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.865058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.865085 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.865076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.866794 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.866774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fcc867aa-15af-4c67-ad76-06b34830d702-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.867037 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.867020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fcc867aa-15af-4c67-ad76-06b34830d702-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:39.876121 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:39.876090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v28f6\" (UniqueName: \"kubernetes.io/projected/fcc867aa-15af-4c67-ad76-06b34830d702-kube-api-access-v28f6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch\" (UID: \"fcc867aa-15af-4c67-ad76-06b34830d702\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:40.036767 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:40.036685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:40.188126 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:40.188099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch"] Jun 10 20:58:40.190107 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:58:40.190080 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc867aa_15af_4c67_ad76_06b34830d702.slice/crio-672ea8bbb9f212fa3d4cad8a071b851648987f460821f47c9599d1e17c0946e8 WatchSource:0}: Error finding container 672ea8bbb9f212fa3d4cad8a071b851648987f460821f47c9599d1e17c0946e8: Status 404 returned error can't find the container with id 672ea8bbb9f212fa3d4cad8a071b851648987f460821f47c9599d1e17c0946e8 Jun 10 20:58:40.942232 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:40.942179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" event={"ID":"fcc867aa-15af-4c67-ad76-06b34830d702","Type":"ContainerStarted","Data":"672ea8bbb9f212fa3d4cad8a071b851648987f460821f47c9599d1e17c0946e8"} Jun 10 20:58:44.975117 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:44.975077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" event={"ID":"fcc867aa-15af-4c67-ad76-06b34830d702","Type":"ContainerStarted","Data":"15174c6a9632bde293bed7111959e678db895ae408f5d4b9848dcd3fc23267ea"} Jun 10 20:58:46.987087 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:46.987054 2578 generic.go:356] "Generic (PLEG): container finished" podID="fcc867aa-15af-4c67-ad76-06b34830d702" containerID="15174c6a9632bde293bed7111959e678db895ae408f5d4b9848dcd3fc23267ea" exitCode=0 Jun 10 20:58:46.987489 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:46.987127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" event={"ID":"fcc867aa-15af-4c67-ad76-06b34830d702","Type":"ContainerDied","Data":"15174c6a9632bde293bed7111959e678db895ae408f5d4b9848dcd3fc23267ea"} Jun 10 20:58:49.007396 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:49.007359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" event={"ID":"fcc867aa-15af-4c67-ad76-06b34830d702","Type":"ContainerStarted","Data":"5ec6aaed98f6ef35b457f1e451e99cead806e0315eb8e13d113a54a19137b7d8"} Jun 10 20:58:49.027782 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:49.027733 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" podStartSLOduration=2.9547555709999997 podStartE2EDuration="10.027714313s" totalImagesPullingTime="5.17259843s" totalInitContainerRuntime="1.900360312s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:58:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:58:49.025680927 +0000 UTC m=+1012.006390388" watchObservedRunningTime="2026-06-10 20:58:49.027714313 +0000 UTC m=+1012.008423774" Jun 10 20:58:50.036944 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:50.036912 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:50.037453 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:50.036973 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:50.049717 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:50.049694 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:58:51.027755 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:58:51.027724 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch" Jun 10 20:59:12.277621 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.277591 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr"] Jun 10 20:59:12.291934 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.291898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:59:12.294426 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.294396 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr"] Jun 10 20:59:12.294574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.294488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.297154 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.297134 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 20:59:12.365521 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.365707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r48qv\" (UniqueName: \"kubernetes.io/projected/714d79f9-f13b-4faa-900c-f906e34135aa-kube-api-access-r48qv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.365707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714d79f9-f13b-4faa-900c-f906e34135aa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.365707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.365707 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.365858 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.365737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.466935 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.466901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467118 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.466941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r48qv\" (UniqueName: \"kubernetes.io/projected/714d79f9-f13b-4faa-900c-f906e34135aa-kube-api-access-r48qv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467118 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.466983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714d79f9-f13b-4faa-900c-f906e34135aa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467118 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467118 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467365 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467144 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467465 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467669 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.467740 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.467675 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.469433 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.469416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/714d79f9-f13b-4faa-900c-f906e34135aa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.469657 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.469636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/714d79f9-f13b-4faa-900c-f906e34135aa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.475204 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.475182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r48qv\" (UniqueName: \"kubernetes.io/projected/714d79f9-f13b-4faa-900c-f906e34135aa-kube-api-access-r48qv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-m6bxr\" (UID: \"714d79f9-f13b-4faa-900c-f906e34135aa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.608146 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.608071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:12.742009 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:12.741972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr"] Jun 10 20:59:12.742463 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:59:12.742439 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714d79f9_f13b_4faa_900c_f906e34135aa.slice/crio-9c056e62e61debce088471dac74c9db3d159016c3f021b941354dac72c862d8a WatchSource:0}: Error finding container 9c056e62e61debce088471dac74c9db3d159016c3f021b941354dac72c862d8a: Status 404 returned error can't find the container with id 9c056e62e61debce088471dac74c9db3d159016c3f021b941354dac72c862d8a Jun 10 20:59:13.130154 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:13.130122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" event={"ID":"714d79f9-f13b-4faa-900c-f906e34135aa","Type":"ContainerStarted","Data":"78e95a60ad38db05298b7a53bd726556ea1c3096d14a46194d1b09ad1dab6e0b"} Jun 10 20:59:13.130378 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:13.130177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" event={"ID":"714d79f9-f13b-4faa-900c-f906e34135aa","Type":"ContainerStarted","Data":"9c056e62e61debce088471dac74c9db3d159016c3f021b941354dac72c862d8a"} Jun 10 20:59:15.143106 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:15.143072 2578 generic.go:356] "Generic (PLEG): container finished" podID="714d79f9-f13b-4faa-900c-f906e34135aa" containerID="78e95a60ad38db05298b7a53bd726556ea1c3096d14a46194d1b09ad1dab6e0b" exitCode=0 Jun 10 20:59:15.143506 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:15.143151 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" event={"ID":"714d79f9-f13b-4faa-900c-f906e34135aa","Type":"ContainerDied","Data":"78e95a60ad38db05298b7a53bd726556ea1c3096d14a46194d1b09ad1dab6e0b"} Jun 10 20:59:16.150567 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:16.150535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" event={"ID":"714d79f9-f13b-4faa-900c-f906e34135aa","Type":"ContainerStarted","Data":"4e977d5d9b3e3cef6a2c394361a144c0689be67d5b1b1016a0425ad893a5118d"} Jun 10 20:59:16.171357 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:16.171301 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" podStartSLOduration=2.655862853 podStartE2EDuration="4.171285281s" totalImagesPullingTime="173.650695ms" totalInitContainerRuntime="1.341771733s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:59:16.168898664 +0000 UTC m=+1039.149608128" watchObservedRunningTime="2026-06-10 20:59:16.171285281 +0000 UTC m=+1039.151994742" Jun 10 20:59:20.795735 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.795694 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs"] Jun 10 20:59:20.798728 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.798709 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.801286 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.801266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 20:59:20.809538 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.809517 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs"] Jun 10 20:59:20.846411 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.846572 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.846572 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a664a98-97ca-42bf-a1b7-61eef99eb120-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.846572 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2bjw\" (UniqueName: \"kubernetes.io/projected/3a664a98-97ca-42bf-a1b7-61eef99eb120-kube-api-access-g2bjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.846722 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.846783 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.846717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.880237 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.880200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:59:20.947420 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a664a98-97ca-42bf-a1b7-61eef99eb120-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2bjw\" (UniqueName: \"kubernetes.io/projected/3a664a98-97ca-42bf-a1b7-61eef99eb120-kube-api-access-g2bjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947607 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947866 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947850 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947982 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.947982 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.947936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.949784 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.949751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a664a98-97ca-42bf-a1b7-61eef99eb120-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.949961 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.949945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a664a98-97ca-42bf-a1b7-61eef99eb120-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:20.956106 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:20.956087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2bjw\" (UniqueName: \"kubernetes.io/projected/3a664a98-97ca-42bf-a1b7-61eef99eb120-kube-api-access-g2bjw\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs\" (UID: \"3a664a98-97ca-42bf-a1b7-61eef99eb120\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:21.108853 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:21.108770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:21.251495 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:21.251470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs"] Jun 10 20:59:21.253369 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:59:21.253341 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a664a98_97ca_42bf_a1b7_61eef99eb120.slice/crio-5fc8997a30cb06de37bdb55fb8cd70be1b068c1c0ca7536a0c3b7eb7f51a2052 WatchSource:0}: Error finding container 5fc8997a30cb06de37bdb55fb8cd70be1b068c1c0ca7536a0c3b7eb7f51a2052: Status 404 returned error can't find the container with id 5fc8997a30cb06de37bdb55fb8cd70be1b068c1c0ca7536a0c3b7eb7f51a2052 Jun 10 20:59:22.183748 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:22.183715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" event={"ID":"3a664a98-97ca-42bf-a1b7-61eef99eb120","Type":"ContainerStarted","Data":"45cfb9c2e0a9421f7255302cb30bce8058854e80a57889d21ea61663019a75d6"} Jun 10 20:59:22.184180 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:22.183767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" event={"ID":"3a664a98-97ca-42bf-a1b7-61eef99eb120","Type":"ContainerStarted","Data":"5fc8997a30cb06de37bdb55fb8cd70be1b068c1c0ca7536a0c3b7eb7f51a2052"} Jun 10 20:59:22.609294 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:22.609188 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:22.609294 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:22.609272 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:22.623400 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:22.623374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:23.190713 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:23.190682 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a664a98-97ca-42bf-a1b7-61eef99eb120" containerID="45cfb9c2e0a9421f7255302cb30bce8058854e80a57889d21ea61663019a75d6" exitCode=0 Jun 10 20:59:23.191088 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:23.190768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" event={"ID":"3a664a98-97ca-42bf-a1b7-61eef99eb120","Type":"ContainerDied","Data":"45cfb9c2e0a9421f7255302cb30bce8058854e80a57889d21ea61663019a75d6"} Jun 10 20:59:23.202591 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:23.202571 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-m6bxr" Jun 10 20:59:24.197321 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:24.197284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" event={"ID":"3a664a98-97ca-42bf-a1b7-61eef99eb120","Type":"ContainerStarted","Data":"91b2f971836176e423945d262d577679432e1389fe2d6873e0c56cdf15177b02"} Jun 10 20:59:24.218900 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:24.218850 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" podStartSLOduration=2.650522153 podStartE2EDuration="4.218833318s" totalImagesPullingTime="226.565105ms" totalInitContainerRuntime="1.34174606s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:59:24.217730055 +0000 UTC m=+1047.198439527" watchObservedRunningTime="2026-06-10 20:59:24.218833318 +0000 UTC m=+1047.199542779" Jun 10 20:59:29.137197 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:29.137157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:59:31.109092 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:31.109053 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:31.109571 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:31.109179 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:31.121500 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:31.121471 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:31.253175 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:31.253142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs" Jun 10 20:59:56.407363 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.407333 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp"] Jun 10 20:59:56.410815 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.410794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.413580 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.413556 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 20:59:56.424900 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.424875 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp"] Jun 10 20:59:56.434214 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.434177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 20:59:56.465063 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.465182 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w6m\" (UniqueName: \"kubernetes.io/projected/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kube-api-access-22w6m\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.465230 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.465303 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.465349 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.465386 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.465364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3823ce-50af-442d-82a8-b2851c1d4bbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.566683 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.566848 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w6m\" (UniqueName: \"kubernetes.io/projected/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kube-api-access-22w6m\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.566848 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.566848 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.566848 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.567033 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.566857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3823ce-50af-442d-82a8-b2851c1d4bbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.567213 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.567178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.567213 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.567196 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.567381 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.567259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.568980 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.568954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3823ce-50af-442d-82a8-b2851c1d4bbf-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.569200 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.569184 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3823ce-50af-442d-82a8-b2851c1d4bbf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.575272 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.575233 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w6m\" (UniqueName: \"kubernetes.io/projected/bc3823ce-50af-442d-82a8-b2851c1d4bbf-kube-api-access-22w6m\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp\" (UID: \"bc3823ce-50af-442d-82a8-b2851c1d4bbf\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.721649 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.721603 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 20:59:56.858286 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:56.858259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp"] Jun 10 20:59:56.860004 ip-10-0-142-242 kubenswrapper[2578]: W0610 20:59:56.859983 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3823ce_50af_442d_82a8_b2851c1d4bbf.slice/crio-60099bee191e28578a784c1b2e5062dde4340812ed8b5b233baa0da80ebe09e2 WatchSource:0}: Error finding container 60099bee191e28578a784c1b2e5062dde4340812ed8b5b233baa0da80ebe09e2: Status 404 returned error can't find the container with id 60099bee191e28578a784c1b2e5062dde4340812ed8b5b233baa0da80ebe09e2 Jun 10 20:59:57.373406 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:57.373370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" event={"ID":"bc3823ce-50af-442d-82a8-b2851c1d4bbf","Type":"ContainerStarted","Data":"12a0c79afbf596f4df4c97fc6cb764dafb0d12e41319a9bd5103c215a59962a8"} Jun 10 20:59:57.373574 ip-10-0-142-242 kubenswrapper[2578]: I0610 20:59:57.373422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" event={"ID":"bc3823ce-50af-442d-82a8-b2851c1d4bbf","Type":"ContainerStarted","Data":"60099bee191e28578a784c1b2e5062dde4340812ed8b5b233baa0da80ebe09e2"} Jun 10 21:00:00.902373 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:00.902338 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd"] Jun 10 21:00:00.905857 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:00.905836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:00.908797 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:00.908780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 21:00:00.917854 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:00.917829 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd"] Jun 10 21:00:01.006480 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prj7j\" (UniqueName: \"kubernetes.io/projected/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kube-api-access-prj7j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.006652 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.006652 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006540 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.006652 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.006652 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.006783 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.006689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.014651 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.014618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:00:01.107210 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prj7j\" (UniqueName: \"kubernetes.io/projected/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kube-api-access-prj7j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.107394 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.107394 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.107394 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.107394 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.107571 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.108100 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.107714 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.108285 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.108057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.108285 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.108197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.118072 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.118044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prj7j\" (UniqueName: \"kubernetes.io/projected/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-kube-api-access-prj7j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.118526 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.118500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.120120 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.120099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d91e068-d7fc-4279-be7f-a0fec7ee6d3e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-c42zd\" (UID: \"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.215897 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.215853 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:01.363942 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.363917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd"] Jun 10 21:00:01.365671 ip-10-0-142-242 kubenswrapper[2578]: W0610 21:00:01.365642 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d91e068_d7fc_4279_be7f_a0fec7ee6d3e.slice/crio-3f07dbd5c147e5d3e4bf401548603fe51a67965e9957cf242354dcdf18865857 WatchSource:0}: Error finding container 3f07dbd5c147e5d3e4bf401548603fe51a67965e9957cf242354dcdf18865857: Status 404 returned error can't find the container with id 3f07dbd5c147e5d3e4bf401548603fe51a67965e9957cf242354dcdf18865857 Jun 10 21:00:01.395180 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:01.395150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" event={"ID":"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e","Type":"ContainerStarted","Data":"3f07dbd5c147e5d3e4bf401548603fe51a67965e9957cf242354dcdf18865857"} Jun 10 21:00:02.402775 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:02.402739 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" event={"ID":"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e","Type":"ContainerStarted","Data":"db5ae3b0de137005b4a91a170d9daaae787073daaada060d840c340e8f6ff677"} Jun 10 21:00:03.168121 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:03.168026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:00:03.221080 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:03.221046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:00:03.410144 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:03.410108 2578 generic.go:356] "Generic (PLEG): container finished" podID="2d91e068-d7fc-4279-be7f-a0fec7ee6d3e" containerID="db5ae3b0de137005b4a91a170d9daaae787073daaada060d840c340e8f6ff677" exitCode=0 Jun 10 21:00:03.410546 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:03.410153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" event={"ID":"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e","Type":"ContainerDied","Data":"db5ae3b0de137005b4a91a170d9daaae787073daaada060d840c340e8f6ff677"} Jun 10 21:00:06.427958 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:06.427924 2578 generic.go:356] "Generic (PLEG): container finished" podID="bc3823ce-50af-442d-82a8-b2851c1d4bbf" containerID="12a0c79afbf596f4df4c97fc6cb764dafb0d12e41319a9bd5103c215a59962a8" exitCode=0 Jun 10 21:00:06.428355 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:06.427996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" event={"ID":"bc3823ce-50af-442d-82a8-b2851c1d4bbf","Type":"ContainerDied","Data":"12a0c79afbf596f4df4c97fc6cb764dafb0d12e41319a9bd5103c215a59962a8"} Jun 10 21:00:11.457126 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:11.457096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" event={"ID":"2d91e068-d7fc-4279-be7f-a0fec7ee6d3e","Type":"ContainerStarted","Data":"77011ca435c1a053a3d82ebc779cf81f8993051af804e149b7a02b7133e8b5e1"} Jun 10 21:00:11.475467 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:11.475421 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" podStartSLOduration=2.989444065 podStartE2EDuration="11.475405403s" totalImagesPullingTime="7.179344051s" totalInitContainerRuntime="1.306617287s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:00:11.474609196 +0000 UTC m=+1094.455318658" watchObservedRunningTime="2026-06-10 21:00:11.475405403 +0000 UTC m=+1094.456114873" Jun 10 21:00:15.326744 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:15.326707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:00:21.216922 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.216875 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:21.217414 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.216939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:21.229467 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.229434 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:21.511072 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.510987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" event={"ID":"bc3823ce-50af-442d-82a8-b2851c1d4bbf","Type":"ContainerStarted","Data":"f4748056e97f706b5becb7ff61b25265ecc6798dcf76aabbe28f11f1b7d84ff6"} Jun 10 21:00:21.522526 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.522503 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-c42zd" Jun 10 21:00:21.531666 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:21.531624 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" podStartSLOduration=2.1395557849999998 podStartE2EDuration="25.531609865s" totalImagesPullingTime="14.412616007s" totalInitContainerRuntime="8.979438073s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:00:21.529458448 +0000 UTC m=+1104.510167919" watchObservedRunningTime="2026-06-10 21:00:21.531609865 +0000 UTC m=+1104.512319371" Jun 10 21:00:26.722533 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:26.722493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 21:00:26.724185 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:26.722560 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 21:00:26.735172 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:26.735147 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 21:00:27.553840 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:27.553815 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp" Jun 10 21:00:37.025285 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:00:37.025232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:01:11.063445 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:01:11.063411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:01:11.163595 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:01:11.163553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:01:12.161703 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:01:12.161651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:01:12.263746 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:01:12.263719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:02:38.420664 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.420613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:02:38.523354 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.523322 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 21:02:38.523590 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.523504 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-777875845c-x2t8z" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerName="manager" containerID="cri-o://2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5" gracePeriod=30 Jun 10 21:02:38.673227 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.673142 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-777875845c-x2t8z" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.37:8081/readyz\": dial tcp 10.133.0.37:8081: connect: connection refused" Jun 10 21:02:38.774858 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.774828 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 21:02:38.812124 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.812089 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjzwj\" (UniqueName: \"kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj\") pod \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " Jun 10 21:02:38.812336 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.812192 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert\") pod \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\" (UID: \"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043\") " Jun 10 21:02:38.814298 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.814270 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" (UID: "a0c9c9a0-0a3d-4b1b-9f7e-718a03773043"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 21:02:38.814427 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.814278 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj" (OuterVolumeSpecName: "kube-api-access-mjzwj") pod "a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" (UID: "a0c9c9a0-0a3d-4b1b-9f7e-718a03773043"). InnerVolumeSpecName "kube-api-access-mjzwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:02:38.913697 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.913666 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-webhook-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:02:38.913697 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:38.913695 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjzwj\" (UniqueName: \"kubernetes.io/projected/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043-kube-api-access-mjzwj\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:02:39.255307 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.255268 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerID="2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5" exitCode=0 Jun 10 21:02:39.255504 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.255331 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-777875845c-x2t8z" Jun 10 21:02:39.255504 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.255359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-x2t8z" event={"ID":"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043","Type":"ContainerDied","Data":"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5"} Jun 10 21:02:39.255504 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.255424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-777875845c-x2t8z" event={"ID":"a0c9c9a0-0a3d-4b1b-9f7e-718a03773043","Type":"ContainerDied","Data":"5b4f0a53a51429e39a8515780d4a80fd3923ce6dcdf51048f3e8aba67049c7cc"} Jun 10 21:02:39.255504 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.255454 2578 scope.go:117] "RemoveContainer" containerID="2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5" Jun 10 21:02:39.265173 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.265154 2578 scope.go:117] "RemoveContainer" containerID="2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5" Jun 10 21:02:39.265445 ip-10-0-142-242 kubenswrapper[2578]: E0610 21:02:39.265426 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5\": container with ID starting with 2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5 not found: ID does not exist" containerID="2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5" Jun 10 21:02:39.265517 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.265453 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5"} err="failed to get container status \"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5\": rpc error: code = NotFound desc = could not find container \"2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5\": container with ID starting with 2da5afc604837623bc251d569943562608bd89f751a1c7cbfca29fb09b84c8b5 not found: ID does not exist" Jun 10 21:02:39.277678 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.277652 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 21:02:39.281546 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.281523 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-777875845c-x2t8z"] Jun 10 21:02:39.455815 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.455777 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" path="/var/lib/kubelet/pods/a0c9c9a0-0a3d-4b1b-9f7e-718a03773043/volumes" Jun 10 21:02:39.919139 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:02:39.919106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:03:21.795577 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:03:21.795537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:03:21.889571 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:03:21.889535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:03:30.300517 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:03:30.300478 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:03:36.359561 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:03:36.359519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:03:36.416481 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:03:36.416449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:08.577674 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:08.577634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:08.665860 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:08.665814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:26.770009 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:26.769928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:26.869451 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:26.869417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:32.515140 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:32.515101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.325059 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.325017 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.380076 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.380041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.455981 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.455945 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.553968 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.553934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.683041 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.682996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:38.779157 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:38.779119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:50.510431 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:50.510388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:50.563723 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:50.563686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:55.254383 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:55.254347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:55.372529 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:55.372491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:04:55.475268 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:04:55.475093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:01.419003 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:01.418963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:01.519672 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:01.519631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:09.567002 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:09.566965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:09.672436 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:09.672402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:09.775424 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:09.775387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:09.878424 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:09.878336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:16.993707 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:16.993657 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:26.335389 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:26.335347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:26.451576 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:26.451545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:26.599232 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:26.599149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:32.764127 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:32.764090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:32.813709 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:32.813659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:32.867342 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:32.867306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:49.096732 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:49.096641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:49.197770 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:49.197732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:49.326373 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:49.326338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:55.384516 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:55.384480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:55.438156 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:55.438120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:55.501521 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:55.501493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:55.600595 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:55.600565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:05:55.716160 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:05:55.716128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:06:01.896767 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:06:01.896733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:06:01.956310 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:06:01.956279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:06:22.744371 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:06:22.744331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:12:49.025420 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.025381 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 21:12:49.025944 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.025600 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" podUID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" containerName="manager" containerID="cri-o://7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923" gracePeriod=10 Jun 10 21:12:49.283941 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.283877 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 21:12:49.320388 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.320356 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume\") pod \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " Jun 10 21:12:49.320546 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.320517 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95gs5\" (UniqueName: \"kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5\") pod \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\" (UID: \"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9\") " Jun 10 21:12:49.320807 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.320780 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" (UID: "1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:12:49.322543 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.322509 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5" (OuterVolumeSpecName: "kube-api-access-95gs5") pod "1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" (UID: "1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9"). InnerVolumeSpecName "kube-api-access-95gs5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:12:49.418392 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.418362 2578 generic.go:356] "Generic (PLEG): container finished" podID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" containerID="7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923" exitCode=0 Jun 10 21:12:49.418578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.418398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" event={"ID":"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9","Type":"ContainerDied","Data":"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923"} Jun 10 21:12:49.418578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.418415 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" Jun 10 21:12:49.418578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.418440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr" event={"ID":"1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9","Type":"ContainerDied","Data":"58b7b2cb2a17239c210f4f0c02241a6784aa2a5bb52d959622d2089ae454e8f0"} Jun 10 21:12:49.418578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.418470 2578 scope.go:117] "RemoveContainer" containerID="7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923" Jun 10 21:12:49.421392 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.421367 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95gs5\" (UniqueName: \"kubernetes.io/projected/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-kube-api-access-95gs5\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:12:49.421509 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.421398 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9-extensions-socket-volume\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:12:49.431831 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.431808 2578 scope.go:117] "RemoveContainer" containerID="7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923" Jun 10 21:12:49.436570 ip-10-0-142-242 kubenswrapper[2578]: E0610 21:12:49.436549 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923\": container with ID starting with 7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923 not found: ID does not exist" containerID="7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923" Jun 10 21:12:49.436671 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.436576 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923"} err="failed to get container status \"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923\": rpc error: code = NotFound desc = could not find container \"7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923\": container with ID starting with 7c7150f287554596db0fa2d0586a4f542a343105ae7185c5926a99a626d2b923 not found: ID does not exist" Jun 10 21:12:49.446471 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.446443 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 21:12:49.455161 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:49.455142 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25znr"] Jun 10 21:12:51.455782 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:12:51.455749 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" path="/var/lib/kubelet/pods/1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9/volumes" Jun 10 21:13:11.878445 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:13:11.878408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:13:51.761063 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:13:51.761024 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:14:05.277199 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:14:05.277163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:14:05.379462 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:14:05.379427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:18:49.754548 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:18:49.754514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:20:19.302665 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:20:19.302626 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:22:39.391096 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:22:39.391021 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:22:42.667676 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:22:42.667637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:06.935788 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:06.935753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:19.973648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:19.973615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:21.610893 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.610861 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611268 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerName="manager" Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611280 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerName="manager" Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611303 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" containerName="manager" Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611309 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" containerName="manager" Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611368 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c9c9a0-0a3d-4b1b-9f7e-718a03773043" containerName="manager" Jun 10 21:23:21.611377 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.611378 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c160c9b-5234-412f-bcfa-7a9fc8cf3bb9" containerName="manager" Jun 10 21:23:21.614438 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.614416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.617367 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.617340 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6c8278db-openshift-default-dockercfg-c7jx6\"" Jun 10 21:23:21.632668 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.632638 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:21.637766 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.637743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:21.685972 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.685940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:21.732831 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.732790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.732831 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.732828 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733081 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.732857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733081 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.732964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733081 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.733021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733081 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.733064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733327 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.733098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sllv\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733327 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.733129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.733327 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.733180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.833796 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.833762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sllv\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.833996 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.833805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.833996 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.833886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.833996 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.833971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834173 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.833998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834173 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:21.834173 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834173 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834422 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834422 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834422 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834386 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834587 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834587 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834786 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.834877 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.834837 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.836607 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.836585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.836797 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.836777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.848900 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.848851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.850172 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.850140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sllv\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv\") pod \"e2e-ait-6c8278db-openshift-default-964446b6-kfx69\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.926517 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.926428 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:21.938902 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:21.938686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:22.083442 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.083410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:22.084846 ip-10-0-142-242 kubenswrapper[2578]: W0610 21:23:22.084796 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d80d930_07e5_44c3_8c54_10a15df32176.slice/crio-ba868588e04b39c96bc4a4a27d18ace8f5d1ba4011d96c2d453ee9a783867008 WatchSource:0}: Error finding container ba868588e04b39c96bc4a4a27d18ace8f5d1ba4011d96c2d453ee9a783867008: Status 404 returned error can't find the container with id ba868588e04b39c96bc4a4a27d18ace8f5d1ba4011d96c2d453ee9a783867008 Jun 10 21:23:22.086851 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.086817 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:22.086945 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.086895 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:22.086945 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.086940 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:22.696686 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.696643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" event={"ID":"7d80d930-07e5-44c3-8c54-10a15df32176","Type":"ContainerStarted","Data":"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201"} Jun 10 21:23:22.697158 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.696712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" event={"ID":"7d80d930-07e5-44c3-8c54-10a15df32176","Type":"ContainerStarted","Data":"ba868588e04b39c96bc4a4a27d18ace8f5d1ba4011d96c2d453ee9a783867008"} Jun 10 21:23:22.718845 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.718792 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" podStartSLOduration=1.718778102 podStartE2EDuration="1.718778102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:23:22.717293465 +0000 UTC m=+2485.698002975" watchObservedRunningTime="2026-06-10 21:23:22.718778102 +0000 UTC m=+2485.699487562" Jun 10 21:23:22.927396 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:22.927367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:23.932326 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:23.932295 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:24.707113 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:24.707081 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:24.707965 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:24.707946 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:24.918917 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:24.918889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:27.921616 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:27.921577 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:28.091706 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:28.091672 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:28.091929 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:28.091905 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" podUID="7d80d930-07e5-44c3-8c54-10a15df32176" containerName="istio-proxy" containerID="cri-o://102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201" gracePeriod=30 Jun 10 21:23:28.117108 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:28.117076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:28.214743 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:28.214709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:29.385817 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:29.385781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:33.347975 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.347955 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:33.458490 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458465 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458500 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458543 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458580 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sllv\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458601 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458648 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458647 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458720 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458723 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy\") pod \"7d80d930-07e5-44c3-8c54-10a15df32176\" (UID: \"7d80d930-07e5-44c3-8c54-10a15df32176\") " Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458784 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:33.458885 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458840 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:33.459179 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.458965 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:33.459258 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.459191 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.459258 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.459195 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 21:23:33.459258 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.459212 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.459258 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.459227 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.459388 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.459258 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.461025 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.460994 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 21:23:33.461025 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.461010 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:33.461223 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.461203 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:23:33.461379 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.461233 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv" (OuterVolumeSpecName: "kube-api-access-5sllv") pod "7d80d930-07e5-44c3-8c54-10a15df32176" (UID: "7d80d930-07e5-44c3-8c54-10a15df32176"). InnerVolumeSpecName "kube-api-access-5sllv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:23:33.560582 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.560554 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d80d930-07e5-44c3-8c54-10a15df32176-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.560582 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.560578 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d80d930-07e5-44c3-8c54-10a15df32176-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.560582 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.560588 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.560768 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.560597 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d80d930-07e5-44c3-8c54-10a15df32176-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.560768 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.560605 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sllv\" (UniqueName: \"kubernetes.io/projected/7d80d930-07e5-44c3-8c54-10a15df32176-kube-api-access-5sllv\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:33.754020 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.753932 2578 generic.go:356] "Generic (PLEG): container finished" podID="7d80d930-07e5-44c3-8c54-10a15df32176" containerID="102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201" exitCode=0 Jun 10 21:23:33.754020 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.753980 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" Jun 10 21:23:33.754194 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.754021 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" event={"ID":"7d80d930-07e5-44c3-8c54-10a15df32176","Type":"ContainerDied","Data":"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201"} Jun 10 21:23:33.754194 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.754078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69" event={"ID":"7d80d930-07e5-44c3-8c54-10a15df32176","Type":"ContainerDied","Data":"ba868588e04b39c96bc4a4a27d18ace8f5d1ba4011d96c2d453ee9a783867008"} Jun 10 21:23:33.754194 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.754107 2578 scope.go:117] "RemoveContainer" containerID="102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201" Jun 10 21:23:33.763687 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.763668 2578 scope.go:117] "RemoveContainer" containerID="102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201" Jun 10 21:23:33.763923 ip-10-0-142-242 kubenswrapper[2578]: E0610 21:23:33.763908 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201\": container with ID starting with 102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201 not found: ID does not exist" containerID="102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201" Jun 10 21:23:33.763971 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.763930 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201"} err="failed to get container status \"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201\": rpc error: code = NotFound desc = could not find container \"102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201\": container with ID starting with 102518af12d21aa05015c2ec0fe98d5d615216faabbf20248576d811836bd201 not found: ID does not exist" Jun 10 21:23:33.779966 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.779938 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:33.784689 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:33.784668 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6c8278db-openshift-default-964446b6-kfx69"] Jun 10 21:23:34.154014 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.153930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.215060 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.215012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.327580 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.327550 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:34.328308 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.328287 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d80d930-07e5-44c3-8c54-10a15df32176" containerName="istio-proxy" Jun 10 21:23:34.328384 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.328312 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d80d930-07e5-44c3-8c54-10a15df32176" containerName="istio-proxy" Jun 10 21:23:34.328447 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.328437 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d80d930-07e5-44c3-8c54-10a15df32176" containerName="istio-proxy" Jun 10 21:23:34.333318 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.333295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.336314 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.336293 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-48c71b87-openshift-default-dockercfg-c7pmt\"" Jun 10 21:23:34.343016 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.342995 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:34.366341 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.366307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.461305 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.461235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.470514 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470650 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470650 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470750 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470750 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470825 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzb4h\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470825 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470929 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.470929 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.470910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.561843 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.561809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.571757 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.571895 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571763 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.571895 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.571895 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzb4h\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.571895 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572092 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572092 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.571965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572302 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572407 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572407 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572523 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572673 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572645 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572853 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.572922 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.572906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.574170 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.574151 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.574746 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.574723 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.581828 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.581807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzb4h\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.582049 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.582025 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token\") pod \"e2e-ait-48c71b87-openshift-default-788f484558-8p4zj\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.651808 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.650429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:34.663983 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.663938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:34.793063 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.793036 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:34.794668 ip-10-0-142-242 kubenswrapper[2578]: W0610 21:23:34.794641 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba81b0fd_1a96_4bee_883c_2606d8e450a6.slice/crio-dfd30de7cc6c926f9166c7672cd6728b9ba1525a7d1595a223ea6664071ada44 WatchSource:0}: Error finding container dfd30de7cc6c926f9166c7672cd6728b9ba1525a7d1595a223ea6664071ada44: Status 404 returned error can't find the container with id dfd30de7cc6c926f9166c7672cd6728b9ba1525a7d1595a223ea6664071ada44 Jun 10 21:23:34.797292 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.797258 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:34.797366 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.797333 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:34.797406 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:34.797371 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 21:23:35.455969 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:35.455930 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d80d930-07e5-44c3-8c54-10a15df32176" path="/var/lib/kubelet/pods/7d80d930-07e5-44c3-8c54-10a15df32176/volumes" Jun 10 21:23:35.768768 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:35.768687 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" event={"ID":"ba81b0fd-1a96-4bee-883c-2606d8e450a6","Type":"ContainerStarted","Data":"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f"} Jun 10 21:23:35.768768 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:35.768735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" event={"ID":"ba81b0fd-1a96-4bee-883c-2606d8e450a6","Type":"ContainerStarted","Data":"dfd30de7cc6c926f9166c7672cd6728b9ba1525a7d1595a223ea6664071ada44"} Jun 10 21:23:35.791413 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:35.791367 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" podStartSLOduration=1.79135256 podStartE2EDuration="1.79135256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 21:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:23:35.789335155 +0000 UTC m=+2498.770044615" watchObservedRunningTime="2026-06-10 21:23:35.79135256 +0000 UTC m=+2498.772062021" Jun 10 21:23:36.162716 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:36.162633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:36.651682 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:36.651646 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:36.656485 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:36.656463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:36.774135 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:36.774104 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:36.775085 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:36.775066 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:37.581831 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:37.581803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:40.616232 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:40.616197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:41.766208 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:41.766174 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:41.766618 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:41.766375 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" podUID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" containerName="istio-proxy" containerID="cri-o://b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f" gracePeriod=30 Jun 10 21:23:41.789319 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:41.789282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:41.889448 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:41.889413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:43.262071 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:43.262046 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:47.024453 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.024425 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:47.092578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092489 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092540 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092578 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092565 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092598 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092670 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzb4h\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092713 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092754 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092781 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.092836 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092830 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:47.093140 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092874 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token\") pod \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\" (UID: \"ba81b0fd-1a96-4bee-883c-2606d8e450a6\") " Jun 10 21:23:47.093140 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092965 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:47.093140 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.092985 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:47.093140 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093101 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:47.093443 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093345 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 21:23:47.093505 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093490 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-data\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.093562 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093512 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istiod-ca-cert\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.093562 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093526 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-certs\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.093562 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093538 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-workload-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.093562 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.093547 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-credential-socket\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.094976 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.094948 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:23:47.095107 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.094980 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h" (OuterVolumeSpecName: "kube-api-access-mzb4h") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "kube-api-access-mzb4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 21:23:47.095369 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.095346 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 21:23:47.095423 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.095352 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba81b0fd-1a96-4bee-883c-2606d8e450a6" (UID: "ba81b0fd-1a96-4bee-883c-2606d8e450a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 21:23:47.194161 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.194122 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-podinfo\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.194161 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.194155 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzb4h\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-kube-api-access-mzb4h\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.194371 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.194169 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-envoy\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.194371 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.194181 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba81b0fd-1a96-4bee-883c-2606d8e450a6-istio-token\") on node \"ip-10-0-142-242.ec2.internal\" DevicePath \"\"" Jun 10 21:23:47.643296 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.643261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:47.706207 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.706170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:23:47.832598 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.832511 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" containerID="b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f" exitCode=0 Jun 10 21:23:47.832598 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.832563 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" Jun 10 21:23:47.832828 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.832600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" event={"ID":"ba81b0fd-1a96-4bee-883c-2606d8e450a6","Type":"ContainerDied","Data":"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f"} Jun 10 21:23:47.832828 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.832668 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj" event={"ID":"ba81b0fd-1a96-4bee-883c-2606d8e450a6","Type":"ContainerDied","Data":"dfd30de7cc6c926f9166c7672cd6728b9ba1525a7d1595a223ea6664071ada44"} Jun 10 21:23:47.832828 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.832701 2578 scope.go:117] "RemoveContainer" containerID="b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f" Jun 10 21:23:47.841776 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.841759 2578 scope.go:117] "RemoveContainer" containerID="b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f" Jun 10 21:23:47.842014 ip-10-0-142-242 kubenswrapper[2578]: E0610 21:23:47.841994 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f\": container with ID starting with b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f not found: ID does not exist" containerID="b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f" Jun 10 21:23:47.842078 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.842020 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f"} err="failed to get container status \"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f\": rpc error: code = NotFound desc = could not find container \"b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f\": container with ID starting with b045bfe2b9c4c1039cfe9e1ab9c7239667bca4fe600e099772b5da1750ced59f not found: ID does not exist" Jun 10 21:23:47.854083 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.853940 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:47.856298 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:47.856275 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-48c71b87-openshift-default-788f484558-8p4zj"] Jun 10 21:23:49.461615 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:49.461579 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" path="/var/lib/kubelet/pods/ba81b0fd-1a96-4bee-883c-2606d8e450a6/volumes" Jun 10 21:23:58.619921 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:58.619884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccf667d6f-j9nvc_40f6d0ab-8f3f-486d-92c6-dd779b45f73d/nginx/0.log" Jun 10 21:23:58.855589 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:58.855557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-j7s7n_52011b4b-6f69-4ca7-b0eb-293042aa1670/manager/0.log" Jun 10 21:23:58.966423 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:58.966378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9pwbz_92397519-6f2c-42ad-bc1f-eff5b1789f55/manager/0.log" Jun 10 21:23:59.078942 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:59.078914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbfc7958b-vwgv4_ff61801b-820a-454c-aec7-1595fea71d60/maas-api/0.log" Jun 10 21:23:59.537092 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:59.537062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-twztt_2a0be923-ea33-4135-98bb-d962dcdb057c/server/0.log" Jun 10 21:23:59.651200 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:59.651161 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bdswz_e3492838-ce5a-4930-973d-361575e23b26/manager/0.log" Jun 10 21:23:59.889733 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:59.889626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-dqbpz_1058db89-dfbc-4cc1-b018-a3927230c5aa/copy-manifests/0.log" Jun 10 21:23:59.896207 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:23:59.896181 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-dqbpz_1058db89-dfbc-4cc1-b018-a3927230c5aa/manager/0.log" Jun 10 21:24:01.591591 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:01.591545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4wg8v_e8f17026-db84-483d-80dd-95516415eb58/manager/0.log" Jun 10 21:24:01.699079 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:01.699050 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w4rj7_36212c9a-e0bf-4e4c-9482-c8557a930174/kuadrant-console-plugin/0.log" Jun 10 21:24:01.813612 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:01.813582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n2rlv_71efe025-d306-48f9-b9d3-4269b476904f/registry-server/0.log" Jun 10 21:24:02.191470 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:02.191439 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-92gl2_10f47bea-4452-47cb-b257-c69c1aba248f/manager/0.log" Jun 10 21:24:02.540341 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:02.540231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958dxzb_bbd503d4-8058-4b21-9b7a-3055bef60b4a/istio-proxy/0.log" Jun 10 21:24:02.766411 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:02.766382 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-57cwk_599fbe4f-27e4-4a23-ae28-34f411dc5a3e/kube-auth-proxy/0.log" Jun 10 21:24:02.987207 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:02.987176 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/1.log" Jun 10 21:24:03.103359 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.103324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-6625p_d7e03ae0-b797-45e0-bf9a-c5b7c15db900/payload-pre-processing/0.log" Jun 10 21:24:03.221354 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.221319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9d9pq_e3343b60-d8cc-4b0b-b4b3-645ab315a41d/payload-processing/0.log" Jun 10 21:24:03.665076 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.665049 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch_fcc867aa-15af-4c67-ad76-06b34830d702/storage-initializer/0.log" Jun 10 21:24:03.672423 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.672398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-nmfch_fcc867aa-15af-4c67-ad76-06b34830d702/main/0.log" Jun 10 21:24:03.778918 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.778892 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-m6bxr_714d79f9-f13b-4faa-900c-f906e34135aa/storage-initializer/0.log" Jun 10 21:24:03.785423 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.785401 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-m6bxr_714d79f9-f13b-4faa-900c-f906e34135aa/main/0.log" Jun 10 21:24:03.892519 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.892489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs_3a664a98-97ca-42bf-a1b7-61eef99eb120/storage-initializer/0.log" Jun 10 21:24:03.898921 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:03.898864 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-v9hvs_3a664a98-97ca-42bf-a1b7-61eef99eb120/main/0.log" Jun 10 21:24:04.121059 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:04.121033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp_bc3823ce-50af-442d-82a8-b2851c1d4bbf/storage-initializer/0.log" Jun 10 21:24:04.128662 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:04.128644 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-wqnwp_bc3823ce-50af-442d-82a8-b2851c1d4bbf/main/0.log" Jun 10 21:24:04.233032 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:04.233008 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c42zd_2d91e068-d7fc-4279-be7f-a0fec7ee6d3e/storage-initializer/0.log" Jun 10 21:24:04.238866 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:04.238841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-c42zd_2d91e068-d7fc-4279-be7f-a0fec7ee6d3e/main/0.log" Jun 10 21:24:08.735442 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:08.735404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:24:09.799947 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:09.799913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:24:11.984159 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:11.984127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wm528_ecc487f2-72e4-44e1-aefd-a7f52045d4ba/global-pull-secret-syncer/0.log" Jun 10 21:24:12.030967 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:12.030940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" Jun 10 21:24:12.155942 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:12.155914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-242.ec2.internal_d949ae2e611a72b6f39dd481124458ba/haproxy/0.log" Jun 10 21:24:15.454963 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:15.454937 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-7k489_eee624ba-9c24-4c7f-85f2-7c08137baaef/sail-operator/0.log" Jun 10 21:24:17.330903 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:17.330872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-4wg8v_e8f17026-db84-483d-80dd-95516415eb58/manager/0.log" Jun 10 21:24:17.359041 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:17.359019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w4rj7_36212c9a-e0bf-4e4c-9482-c8557a930174/kuadrant-console-plugin/0.log" Jun 10 21:24:17.402064 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:17.402035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n2rlv_71efe025-d306-48f9-b9d3-4269b476904f/registry-server/0.log" Jun 10 21:24:17.588488 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:17.588456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-92gl2_10f47bea-4452-47cb-b257-c69c1aba248f/manager/0.log" Jun 10 21:24:19.637155 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.637108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl5wk_62256b77-0a9d-4ccb-b62b-3ef93a7b0f87/node-exporter/0.log" Jun 10 21:24:19.654693 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.654668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl5wk_62256b77-0a9d-4ccb-b62b-3ef93a7b0f87/kube-rbac-proxy/0.log" Jun 10 21:24:19.682357 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.682332 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cl5wk_62256b77-0a9d-4ccb-b62b-3ef93a7b0f87/init-textfile/0.log" Jun 10 21:24:19.957622 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.957597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/prometheus/0.log" Jun 10 21:24:19.976804 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.976775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/config-reloader/0.log" Jun 10 21:24:19.999043 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:19.999017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/thanos-sidecar/0.log" Jun 10 21:24:20.022422 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:20.022403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/kube-rbac-proxy-web/0.log" Jun 10 21:24:20.042215 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:20.042198 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/kube-rbac-proxy/0.log" Jun 10 21:24:20.062618 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:20.062599 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/kube-rbac-proxy-thanos/0.log" Jun 10 21:24:20.083026 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:20.083005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_546b5598-9710-4d3a-a137-4c195869f1f2/init-config-reloader/0.log" Jun 10 21:24:23.064087 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.064058 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-vcmlt_6358effc-c242-4c49-b829-891697d925ea/download-server/0.log" Jun 10 21:24:23.678910 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.678876 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2"] Jun 10 21:24:23.679382 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.679363 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" containerName="istio-proxy" Jun 10 21:24:23.679382 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.679383 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" containerName="istio-proxy" Jun 10 21:24:23.679655 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.679538 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba81b0fd-1a96-4bee-883c-2606d8e450a6" containerName="istio-proxy" Jun 10 21:24:23.682912 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.682894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.686845 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.686822 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"kube-root-ca.crt\"" Jun 10 21:24:23.686957 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.686832 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9b7t2\"/\"default-dockercfg-8z9p5\"" Jun 10 21:24:23.686957 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.686890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9b7t2\"/\"openshift-service-ca.crt\"" Jun 10 21:24:23.690941 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.690916 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2"] Jun 10 21:24:23.754469 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.754433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-lib-modules\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.754469 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.754469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-sys\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.754682 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.754509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxtg\" (UniqueName: \"kubernetes.io/projected/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-kube-api-access-kbxtg\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.754682 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.754529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-podres\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.754682 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.754559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-proc\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855616 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-proc\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855809 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855688 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-lib-modules\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855809 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-proc\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855809 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-sys\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855809 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-sys\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.855809 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxtg\" (UniqueName: \"kubernetes.io/projected/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-kube-api-access-kbxtg\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.856010 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-podres\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.856010 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855865 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-lib-modules\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.856010 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.855942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-podres\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.863918 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.863893 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxtg\" (UniqueName: \"kubernetes.io/projected/e518e999-0b46-43e6-bbc1-2b59f5bb7a63-kube-api-access-kbxtg\") pod \"perf-node-gather-daemonset-5xhd2\" (UID: \"e518e999-0b46-43e6-bbc1-2b59f5bb7a63\") " pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:23.993766 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:23.993729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:24.134902 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:24.134873 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2"] Jun 10 21:24:24.137379 ip-10-0-142-242 kubenswrapper[2578]: W0610 21:24:24.137352 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode518e999_0b46_43e6_bbc1_2b59f5bb7a63.slice/crio-cd505f5581540605e5633000dca66313c4a00574dc0697307b84964335fa47f9 WatchSource:0}: Error finding container cd505f5581540605e5633000dca66313c4a00574dc0697307b84964335fa47f9: Status 404 returned error can't find the container with id cd505f5581540605e5633000dca66313c4a00574dc0697307b84964335fa47f9 Jun 10 21:24:25.029323 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.029281 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" event={"ID":"e518e999-0b46-43e6-bbc1-2b59f5bb7a63","Type":"ContainerStarted","Data":"27e395f5df91f918676aeb6f7e61b1bad9867c82aeee87d6832477442d1650de"} Jun 10 21:24:25.029499 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.029341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" event={"ID":"e518e999-0b46-43e6-bbc1-2b59f5bb7a63","Type":"ContainerStarted","Data":"cd505f5581540605e5633000dca66313c4a00574dc0697307b84964335fa47f9"} Jun 10 21:24:25.029499 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.029457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:25.041180 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.041156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h94w5_d7678507-f422-456f-ab16-5520bb03f98f/dns/0.log" Jun 10 21:24:25.047209 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.047163 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" podStartSLOduration=2.047150629 podStartE2EDuration="2.047150629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 21:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 21:24:25.045074104 +0000 UTC m=+2548.025783564" watchObservedRunningTime="2026-06-10 21:24:25.047150629 +0000 UTC m=+2548.027860089" Jun 10 21:24:25.064511 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.064486 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h94w5_d7678507-f422-456f-ab16-5520bb03f98f/kube-rbac-proxy/0.log" Jun 10 21:24:25.199132 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.199101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7bss_b19a552b-64ae-4943-aa42-92c453f07c10/dns-node-resolver/0.log" Jun 10 21:24:25.752535 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.752501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66968bdff5-4w6fk_9ff6aa35-331a-45e4-bd56-0d27bd404bd4/registry/0.log" Jun 10 21:24:25.760290 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.760269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-66968bdff5-4w6fk_9ff6aa35-331a-45e4-bd56-0d27bd404bd4/registry/1.log" Jun 10 21:24:25.779609 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:25.779566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k7kpd_b1109e67-568f-45bc-9da0-f92b8f930967/node-ca/0.log" Jun 10 21:24:26.764459 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:26.764418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958dxzb_bbd503d4-8058-4b21-9b7a-3055bef60b4a/istio-proxy/0.log" Jun 10 21:24:26.848041 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:26.848019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-57cwk_599fbe4f-27e4-4a23-ae28-34f411dc5a3e/kube-auth-proxy/0.log" Jun 10 21:24:26.899249 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:26.899227 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/0.log" Jun 10 21:24:26.927935 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:26.927911 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/1.log" Jun 10 21:24:26.954509 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:26.954491 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-6625p_d7e03ae0-b797-45e0-bf9a-c5b7c15db900/payload-pre-processing/0.log" Jun 10 21:24:27.007521 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:27.007500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9d9pq_e3343b60-d8cc-4b0b-b4b3-645ab315a41d/payload-processing/0.log" Jun 10 21:24:27.653559 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:27.653531 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6hb2_261fe6fc-3f6e-4cd0-b9f3-898922925213/serve-healthcheck-canary/0.log" Jun 10 21:24:28.260515 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:28.260484 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwmhm_2c931145-ba95-46c7-a675-cfe7d0eca9ea/kube-rbac-proxy/0.log" Jun 10 21:24:28.280613 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:28.280590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwmhm_2c931145-ba95-46c7-a675-cfe7d0eca9ea/exporter/0.log" Jun 10 21:24:28.300747 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:28.300727 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hwmhm_2c931145-ba95-46c7-a675-cfe7d0eca9ea/extractor/0.log" Jun 10 21:24:30.554776 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.554749 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-ccf667d6f-j9nvc_40f6d0ab-8f3f-486d-92c6-dd779b45f73d/nginx/0.log" Jun 10 21:24:30.605044 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.605017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-j7s7n_52011b4b-6f69-4ca7-b0eb-293042aa1670/manager/0.log" Jun 10 21:24:30.676828 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.676795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-9pwbz_92397519-6f2c-42ad-bc1f-eff5b1789f55/manager/0.log" Jun 10 21:24:30.710859 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.710832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbfc7958b-vwgv4_ff61801b-820a-454c-aec7-1595fea71d60/maas-api/0.log" Jun 10 21:24:30.854606 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.854534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-twztt_2a0be923-ea33-4135-98bb-d962dcdb057c/server/0.log" Jun 10 21:24:30.903790 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:30.903765 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-bdswz_e3492838-ce5a-4930-973d-361575e23b26/manager/0.log" Jun 10 21:24:31.037814 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:31.037782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-dqbpz_1058db89-dfbc-4cc1-b018-a3927230c5aa/manager/0.log" Jun 10 21:24:31.044974 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:31.044952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9b7t2/perf-node-gather-daemonset-5xhd2" Jun 10 21:24:31.059088 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:31.059067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-546b599574-dqbpz_1058db89-dfbc-4cc1-b018-a3927230c5aa/copy-manifests/0.log" Jun 10 21:24:35.820149 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:35.820125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:24:35.919984 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:35.919957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9d6ln_4a19aa2b-e19b-421c-b93a-dc35e31ceb2e/konnectivity-agent/0.log" limit=1024 Jun 10 21:24:37.346983 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.346932 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958dxzb_bbd503d4-8058-4b21-9b7a-3055bef60b4a/istio-proxy/0.log" Jun 10 21:24:37.413331 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.413307 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-57cwk_599fbe4f-27e4-4a23-ae28-34f411dc5a3e/kube-auth-proxy/0.log" Jun 10 21:24:37.456808 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.456780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/0.log" Jun 10 21:24:37.486758 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.486732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/1.log" Jun 10 21:24:37.505084 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.505062 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-6625p_d7e03ae0-b797-45e0-bf9a-c5b7c15db900/payload-pre-processing/0.log" Jun 10 21:24:37.555110 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:37.555089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9d9pq_e3343b60-d8cc-4b0b-b4b3-645ab315a41d/payload-processing/0.log" Jun 10 21:24:38.628225 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.628200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958dxzb_bbd503d4-8058-4b21-9b7a-3055bef60b4a/istio-proxy/0.log" Jun 10 21:24:38.703135 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.703110 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-57cwk_599fbe4f-27e4-4a23-ae28-34f411dc5a3e/kube-auth-proxy/0.log" Jun 10 21:24:38.739015 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.738985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/0.log" Jun 10 21:24:38.773017 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.772985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/1.log" Jun 10 21:24:38.790941 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.790910 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-6625p_d7e03ae0-b797-45e0-bf9a-c5b7c15db900/payload-pre-processing/0.log" Jun 10 21:24:38.842526 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:38.842498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9d9pq_e3343b60-d8cc-4b0b-b4b3-645ab315a41d/payload-processing/0.log" Jun 10 21:24:39.946786 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:39.946756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/kube-multus-additional-cni-plugins/0.log" Jun 10 21:24:39.968500 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:39.968455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/egress-router-binary-copy/0.log" Jun 10 21:24:39.989782 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:39.989757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/cni-plugins/0.log" Jun 10 21:24:40.009515 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.009489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/bond-cni-plugin/0.log" Jun 10 21:24:40.032450 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.032429 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/routeoverride-cni/0.log" Jun 10 21:24:40.050794 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.050774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/whereabouts-cni-bincopy/0.log" Jun 10 21:24:40.071137 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.071113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhnf4_eea6a1c7-c6ec-4a36-9fa5-7b4d6b88c397/whereabouts-cni/0.log" Jun 10 21:24:40.465253 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.465210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958dxzb_bbd503d4-8058-4b21-9b7a-3055bef60b4a/istio-proxy/0.log" Jun 10 21:24:40.549450 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.549421 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64cf7df7f-57cwk_599fbe4f-27e4-4a23-ae28-34f411dc5a3e/kube-auth-proxy/0.log" Jun 10 21:24:40.587608 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.587579 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r4mnf_e86bdc87-d25c-466a-9c13-21d03260eadd/kube-multus/0.log" Jun 10 21:24:40.599503 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.599476 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/0.log" Jun 10 21:24:40.629433 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.629410 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-6bplr_82a22c0f-f733-4a32-a2b7-91cf997e4755/istio-proxy/1.log" Jun 10 21:24:40.652361 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.652342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-6625p_d7e03ae0-b797-45e0-bf9a-c5b7c15db900/payload-pre-processing/0.log" Jun 10 21:24:40.700466 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.700443 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-9d9pq_e3343b60-d8cc-4b0b-b4b3-645ab315a41d/payload-processing/0.log" Jun 10 21:24:40.798572 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.798487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cz8dr_61be2b8a-feac-4a56-a54c-5cdd5b18341f/network-metrics-daemon/0.log" Jun 10 21:24:40.849373 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:40.849332 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cz8dr_61be2b8a-feac-4a56-a54c-5cdd5b18341f/kube-rbac-proxy/0.log" Jun 10 21:24:42.247973 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.247936 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/ovn-controller/0.log" Jun 10 21:24:42.266570 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.266546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/ovn-acl-logging/0.log" Jun 10 21:24:42.290695 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.290671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/kube-rbac-proxy-node/0.log" Jun 10 21:24:42.311428 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.311402 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 21:24:42.327893 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.327865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/northd/0.log" Jun 10 21:24:42.348233 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.348207 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/nbdb/0.log" Jun 10 21:24:42.368026 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.368004 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/sbdb/0.log" Jun 10 21:24:42.410654 ip-10-0-142-242 kubenswrapper[2578]: I0610 21:24:42.410632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zfwpj_70752b45-7466-4136-8d18-c206768846a7/ovnkube-controller/0.log"