Jun 11 14:25:12.710315 ip-10-0-128-209 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 14:25:12.710326 ip-10-0-128-209 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 14:25:12.710333 ip-10-0-128-209 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 14:25:12.710553 ip-10-0-128-209 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 14:25:23.379131 ip-10-0-128-209 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 11 14:25:23.379144 ip-10-0-128-209 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 85b7ea3af65b492c9d889913e96c73c4 -- Jun 11 14:27:45.435209 ip-10-0-128-209 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:27:45.910430 ip-10-0-128-209 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:27:45.910430 ip-10-0-128-209 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:27:45.910430 ip-10-0-128-209 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:27:45.910430 ip-10-0-128-209 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:27:45.910430 ip-10-0-128-209 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:27:45.911348 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.911263 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:27:45.915826 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915795 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.915826 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915826 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915831 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915835 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915837 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915840 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915843 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915846 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915849 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915852 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915855 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915859 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915863 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915866 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915877 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915880 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915883 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915886 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915889 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915891 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915895 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.915893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915899 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915903 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915905 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915908 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915911 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915913 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915916 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915918 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915922 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915925 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915927 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915929 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915932 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915935 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915937 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915939 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915942 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915945 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915947 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915950 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.916358 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915952 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915954 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915957 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915959 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915961 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915964 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915966 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915969 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915971 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915974 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915976 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915979 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915981 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915984 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915987 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915989 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915992 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915995 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.915997 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.916862 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916000 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916002 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916004 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916007 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916010 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916012 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916016 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916018 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916021 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916023 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916037 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916040 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916043 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916045 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916048 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916051 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916053 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916055 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916058 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916060 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.917331 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916062 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916065 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916068 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916070 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916073 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916075 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916078 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916081 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916084 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916087 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916089 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916092 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916094 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916096 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916099 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916101 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916106 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916109 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916112 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.917823 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916818 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916827 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916830 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916833 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916836 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916840 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916843 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916847 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916850 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916852 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916855 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916857 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916860 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916863 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916868 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916871 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916874 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916877 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916880 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916884 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.918279 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916887 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916889 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916892 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916895 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916897 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916900 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916902 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916905 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916907 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916910 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916912 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916915 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916918 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916920 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916923 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916925 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916928 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916930 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916933 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916936 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.918765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916938 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916940 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916943 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916946 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916949 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916951 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916954 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916956 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916959 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916962 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916966 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916969 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916972 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916975 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916977 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916980 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916983 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916986 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916988 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916991 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.919255 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916994 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916996 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.916998 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917001 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917003 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917012 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917016 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917019 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917022 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917024 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917027 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917030 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917033 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917035 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917038 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917040 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917043 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917045 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917048 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.919765 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917050 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917055 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917058 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917060 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917063 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917066 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917069 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917071 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917074 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917076 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917079 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917082 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917084 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917088 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917091 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917094 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917097 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917100 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917103 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.920277 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917105 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917567 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917573 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917576 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917585 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917593 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917596 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917599 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917602 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917604 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917606 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917609 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917611 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917614 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917618 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917621 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917624 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917627 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917629 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917632 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.920750 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917634 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917637 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917639 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917642 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917645 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917647 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917650 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917652 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917654 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917657 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917659 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917661 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917664 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917666 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917668 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917671 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917673 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917676 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917684 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917686 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.921252 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917689 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917691 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917694 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917696 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917698 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917701 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917704 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917707 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917709 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917712 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917715 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917717 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917720 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917722 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917724 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917727 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917729 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917732 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917736 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.921731 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917739 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917742 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917745 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917748 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917750 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917753 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917756 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917758 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917761 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917764 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917768 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917771 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917776 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917779 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917782 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917784 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917786 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917789 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917791 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.922228 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917813 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917818 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917822 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917826 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917830 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917833 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917836 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917838 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917841 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917843 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917846 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917848 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917851 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917853 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917856 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917858 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917861 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917863 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917865 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917868 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.922676 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917870 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.917872 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917937 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917944 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917950 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917954 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917959 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917962 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917966 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917970 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917973 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917975 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917981 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917985 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917988 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917991 2566 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917993 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917996 2566 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.917999 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918002 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918006 2566 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918009 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918012 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918015 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:27:45.923161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918018 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918021 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918024 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918027 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918030 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918033 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918036 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918038 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918041 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918044 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918048 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918051 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918053 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918056 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918059 2566 flags.go:64] FLAG: --enable-server="true" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918062 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918066 2566 flags.go:64] FLAG: --event-burst="100" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918069 2566 flags.go:64] FLAG: --event-qps="50" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918072 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918074 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918079 2566 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918083 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918085 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918088 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918091 2566 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:27:45.923745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918093 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918096 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918099 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918102 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918105 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918108 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918110 2566 flags.go:64] FLAG: --feature-gates="" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918114 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918117 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918119 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918122 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918125 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918128 2566 flags.go:64] FLAG: --help="false" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918131 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-128-209.ec2.internal" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918134 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918136 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918139 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918142 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918145 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918148 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918151 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918154 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918156 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:27:45.924368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918159 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918162 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918165 2566 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918168 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918173 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918176 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918179 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918181 2566 flags.go:64] FLAG: --lock-file="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918184 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918187 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918190 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918200 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918203 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918206 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918209 2566 flags.go:64] FLAG: --logging-format="text" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918212 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918215 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918218 2566 flags.go:64] FLAG: --manifest-url="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918220 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918224 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918228 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918234 2566 flags.go:64] FLAG: --max-pods="110" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918238 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918241 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918244 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:27:45.925021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918247 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918250 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918253 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918256 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918263 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918265 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918268 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918271 2566 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918274 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918280 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918283 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918286 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918291 2566 flags.go:64] FLAG: --port="10250" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918294 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918296 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d6cbeedecf8f5da5" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918299 2566 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918302 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918305 2566 flags.go:64] FLAG: --register-node="true" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918307 2566 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918311 2566 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918314 2566 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918317 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918319 2566 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918323 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918326 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:27:45.925632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918329 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918331 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918334 2566 flags.go:64] FLAG: --runonce="false" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918336 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918339 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918342 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918345 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918347 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918350 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918353 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918356 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918358 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918361 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918363 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918366 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918369 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918372 2566 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918375 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918381 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918385 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918387 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918391 2566 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918394 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918397 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918400 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:27:45.926239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918402 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918405 2566 flags.go:64] FLAG: --v="2" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918409 2566 flags.go:64] FLAG: --version="false" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918413 2566 flags.go:64] FLAG: --vmodule="" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918416 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.918419 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918543 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918546 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918549 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918552 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918555 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918557 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918560 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918562 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918565 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918568 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918570 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918573 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918575 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918578 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918581 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.926903 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918583 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918585 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918588 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918591 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918594 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918598 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918602 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918606 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918609 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918611 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918614 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918617 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918619 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918622 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918624 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918627 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918629 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918632 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918634 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.927412 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918637 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918639 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918642 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918644 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918647 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918649 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918651 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918654 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918656 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918659 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918661 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918663 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918666 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918669 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918672 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918675 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918677 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918682 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918686 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918688 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.927994 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918691 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918693 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918696 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918698 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918700 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918703 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918706 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918708 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918711 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918713 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918715 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918718 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918720 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918723 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918725 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918729 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918732 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918735 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918737 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.928483 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918739 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918743 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918745 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918747 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918750 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918752 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918755 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918758 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918760 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918763 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918767 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918771 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918773 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918776 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918779 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918781 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918783 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918786 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918788 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918791 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.928953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918793 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918813 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918816 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918818 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918821 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.918823 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.919405 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.926735 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.926754 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.926773 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.926781 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926870 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926875 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926879 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926882 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.929446 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926885 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926887 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926890 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926892 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926895 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926898 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926900 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926903 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926906 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926909 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926913 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926916 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926918 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926921 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926923 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926926 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926928 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926931 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926933 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926936 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.929841 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926939 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926942 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926944 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926947 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926951 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926962 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926966 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926969 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926971 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926974 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926977 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926980 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926983 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926986 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926988 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926991 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926995 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.926998 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927001 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.930374 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927003 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927006 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927008 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927011 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927013 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927016 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927018 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927021 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927023 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927026 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927028 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927032 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927035 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927038 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927041 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927043 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927046 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927049 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927053 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.930846 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927061 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927064 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927066 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927069 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927071 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927074 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927077 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927079 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927082 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927085 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927088 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927090 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927093 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927095 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927098 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927100 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927102 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927105 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927107 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927109 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.931309 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927112 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927115 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927117 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927120 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927122 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927125 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927127 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927130 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927132 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927134 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927137 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927140 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927143 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927151 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927153 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927156 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.931875 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927158 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.927163 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927328 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927332 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927336 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927340 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927343 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927346 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927348 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927351 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927354 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927356 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927358 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927361 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:27:45.932264 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927363 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927366 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927368 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927371 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927374 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927377 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927380 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927382 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927385 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927387 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927389 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927392 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927394 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927397 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927400 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927402 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927411 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927414 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927417 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927420 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:27:45.932640 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927422 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927425 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927428 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927430 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927433 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927435 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927437 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927440 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927443 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927445 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927447 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927449 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927452 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927455 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927457 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927459 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927462 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927464 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927467 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927469 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:27:45.933140 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927471 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927474 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927476 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927479 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927481 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927483 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927486 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927488 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927491 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927502 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927506 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927509 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927512 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927515 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927518 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927521 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927524 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927526 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927528 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:27:45.933611 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927531 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927533 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927536 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927538 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927540 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927543 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927545 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927547 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927550 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927552 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927555 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927557 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927560 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927562 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927564 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927567 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927569 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927571 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927574 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927576 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:27:45.934071 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927579 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927581 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927584 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927591 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927594 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927596 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927599 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:45.927601 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.927606 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.927727 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.930103 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.931419 2566 server.go:1019] "Starting client certificate rotation" Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.931525 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:27:45.934555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.932316 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:27:45.934886 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.934277 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:27:45.940282 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.940210 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:27:45.957066 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.957043 2566 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:27:45.959951 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.959937 2566 log.go:25] "Validated CRI v1 image API" Jun 11 14:27:45.961446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.961434 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:27:45.964449 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.964431 2566 fs.go:135] Filesystem UUIDs: map[55dc6a45-96fe-4bf1-bca8-befa35a291d7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed2f74d9-9ad4-4911-938a-2f290f0d9b97:/dev/nvme0n1p4] Jun 11 14:27:45.964528 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.964448 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:27:45.969197 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.969092 2566 manager.go:216] Machine: {Timestamp:2026-06-11 14:27:45.968557195 +0000 UTC m=+0.394549861 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102786 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24016b86d7acb65d7b8170f6eb0737 SystemUUID:ec24016b-86d7-acb6-5d7b-8170f6eb0737 BootID:85b7ea3a-f65b-492c-9d88-9913e96c73c4 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:0e:8d:04:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:0e:8d:04:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:76:6b:bc:07:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:27:45.969197 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.969191 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:27:45.969347 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.969274 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:27:45.971613 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.971594 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:27:45.972795 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.972773 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:27:45.972971 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.972815 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:27:45.973637 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.973625 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:27:45.973669 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.973641 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:27:45.973669 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.973648 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:27:45.973669 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.973662 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:27:45.974660 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.974650 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:27:45.978503 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978492 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:27:45.978795 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978784 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:27:45.978839 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978832 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:27:45.978873 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978847 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:27:45.978873 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978862 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:27:45.978873 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978873 2566 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:27:45.978964 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.978888 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:27:45.979240 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.979228 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:27:45.979290 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.979249 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:27:45.985700 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.985680 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:27:45.987748 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.987735 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:27:45.987988 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.987972 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:27:45.988763 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988751 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:27:45.988794 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988772 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:27:45.988794 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988784 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:27:45.988794 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988791 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:27:45.988889 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988819 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:27:45.988889 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.988828 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:27:45.989078 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989067 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:27:45.989109 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989081 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:27:45.989109 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989091 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:27:45.989109 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989100 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:27:45.989189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989112 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:27:45.989189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.989124 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:27:45.990111 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.990099 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:27:45.990111 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.990112 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:27:45.991300 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:45.991278 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:27:45.991387 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:45.991334 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:27:45.995223 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.995210 2566 server.go:1268] "Started kubelet" Jun 11 14:27:45.995340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.995296 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:27:45.995340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.995293 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:27:45.995417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.995365 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:27:45.995992 ip-10-0-128-209 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:27:45.997161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.997144 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:27:45.997527 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:45.997508 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:27:46.001561 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.001512 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:27:46.002628 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.001436 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-209.ec2.internal.18b80d1bdfceccd0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-209.ec2.internal,UID:ip-10-0-128-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-209.ec2.internal,},FirstTimestamp:2026-06-11 14:27:45.995181264 +0000 UTC m=+0.421173931,LastTimestamp:2026-06-11 14:27:45.995181264 +0000 UTC m=+0.421173931,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-209.ec2.internal,}" Jun 11 14:27:46.002715 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.002610 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:27:46.005130 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.005109 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:27:46.005130 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.005114 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:27:46.005266 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.005240 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.005956 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.005937 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:27:46.005956 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.005937 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:27:46.006103 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.005963 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:27:46.006103 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006038 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:27:46.006103 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006047 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:27:46.006206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006170 2566 factory.go:153] Registering CRI-O factory Jun 11 14:27:46.006206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006182 2566 factory.go:223] Registration of the crio container factory successfully Jun 11 14:27:46.006272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006226 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:27:46.006272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006234 2566 factory.go:55] Registering systemd factory Jun 11 14:27:46.006272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006242 2566 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:27:46.006272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006262 2566 factory.go:103] Registering Raw factory Jun 11 14:27:46.006449 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006276 2566 manager.go:1196] Started watching for new ooms in manager Jun 11 14:27:46.006703 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.006691 2566 manager.go:349] Starting recovery of all containers Jun 11 14:27:46.015656 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.015481 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 14:27:46.015940 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.015879 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 14:27:46.017995 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.017974 2566 manager.go:354] Recovery completed Jun 11 14:27:46.019387 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.019365 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hcflp" Jun 11 14:27:46.022771 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.022759 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.024679 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.024664 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.024753 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.024693 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.024753 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.024706 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.025260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025235 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:27:46.025260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025248 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.025364 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025251 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:27:46.025364 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025344 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:27:46.025987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025924 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.025987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025955 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.025987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.025969 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.027348 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.027333 2566 policy_none.go:49] "None policy: Start" Jun 11 14:27:46.027348 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.027350 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:27:46.027459 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.027359 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:27:46.027459 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.027400 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hcflp" Jun 11 14:27:46.029065 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.029054 2566 policy_none.go:47] "Start" Jun 11 14:27:46.063355 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063340 2566 manager.go:337] "Starting Device Plugin manager" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.063376 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063386 2566 server.go:87] "Starting device plugin registration server" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063655 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063668 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063754 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063843 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.063853 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.064381 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.064424 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.078414 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.079726 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.079759 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.079777 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.079826 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:27:46.089548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.081660 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:46.164209 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.164180 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.168116 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.168101 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.168181 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.168132 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.168181 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.168141 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.168181 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.168164 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.174356 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.174339 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.174406 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.174364 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-209.ec2.internal\": node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.180233 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.180200 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal"] Jun 11 14:27:46.180299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.180288 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.181223 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.181208 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.181324 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.181234 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.181324 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.181244 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.183422 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.183411 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.183567 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.183553 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.183605 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.183585 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.184144 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184128 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.184194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184158 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.184194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184167 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.184194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184128 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.184278 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184200 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.184278 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.184212 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.185914 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.185897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.185991 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.185923 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:27:46.186554 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.186535 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:27:46.186627 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.186568 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:27:46.186627 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.186582 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:27:46.203002 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.202979 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.207182 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.207162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.207263 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.207186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.207263 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.207203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9aea4a15849b0a3c4984de51c7c9186-config\") pod \"kube-apiserver-proxy-ip-10-0-128-209.ec2.internal\" (UID: \"d9aea4a15849b0a3c4984de51c7c9186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.216474 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.216457 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-209.ec2.internal\" not found" node="ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.220790 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.220775 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-209.ec2.internal\" not found" node="ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.303254 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.303182 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.307478 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.307557 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.307557 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9aea4a15849b0a3c4984de51c7c9186-config\") pod \"kube-apiserver-proxy-ip-10-0-128-209.ec2.internal\" (UID: \"d9aea4a15849b0a3c4984de51c7c9186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.307557 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307468 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.307665 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d9aea4a15849b0a3c4984de51c7c9186-config\") pod \"kube-apiserver-proxy-ip-10-0-128-209.ec2.internal\" (UID: \"d9aea4a15849b0a3c4984de51c7c9186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.307665 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.307589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70845d2db0c0a6f4effd262e73b56c1c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal\" (UID: \"70845d2db0c0a6f4effd262e73b56c1c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.403628 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.403602 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.504363 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.504341 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.522780 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.522761 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.527713 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.527695 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:46.605091 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.605028 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.705478 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.705451 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.805891 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.805861 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.888575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.888515 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:46.906166 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:46.906144 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:46.925367 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.925350 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:46.931237 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.931221 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:27:46.931337 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.931321 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:27:46.931379 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.931363 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:27:46.931379 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:46.931363 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:27:47.006751 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.006723 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.030442 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.030404 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:22:46 +0000 UTC" deadline="2027-12-28 20:48:50.324470119 +0000 UTC" Jun 11 14:27:47.030442 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.030431 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13566h21m3.294041312s" Jun 11 14:27:47.091103 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:47.091052 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9aea4a15849b0a3c4984de51c7c9186.slice/crio-9713cc684283df315419c7ff07c7ee99b4dd86c183e06c715e25ff1cb83744d8 WatchSource:0}: Error finding container 9713cc684283df315419c7ff07c7ee99b4dd86c183e06c715e25ff1cb83744d8: Status 404 returned error can't find the container with id 9713cc684283df315419c7ff07c7ee99b4dd86c183e06c715e25ff1cb83744d8 Jun 11 14:27:47.091683 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:47.091656 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70845d2db0c0a6f4effd262e73b56c1c.slice/crio-0de60ff817f89f6b4a9ec983133d4774fc8e05ca791ad70803fea2f84a1738d5 WatchSource:0}: Error finding container 0de60ff817f89f6b4a9ec983133d4774fc8e05ca791ad70803fea2f84a1738d5: Status 404 returned error can't find the container with id 0de60ff817f89f6b4a9ec983133d4774fc8e05ca791ad70803fea2f84a1738d5 Jun 11 14:27:47.096205 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.096184 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:27:47.107120 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.107090 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.207652 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.207583 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.308087 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.308046 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.408534 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.408504 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.509326 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.509233 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-209.ec2.internal\" not found" Jun 11 14:27:47.572209 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.572184 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:47.606140 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.606079 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" Jun 11 14:27:47.619624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.619594 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:27:47.620942 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.620920 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" Jun 11 14:27:47.632051 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.632029 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:27:47.980511 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.980432 2566 apiserver.go:52] "Watching apiserver" Jun 11 14:27:47.989603 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.989576 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:27:47.989968 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.989935 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-4h55x","kube-system/konnectivity-agent-j4j2h","kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s","openshift-cluster-node-tuning-operator/tuned-44tnr","openshift-multus/multus-xm5q5","openshift-network-diagnostics/network-check-target-bv222","openshift-ovn-kubernetes/ovnkube-node-tnknt","kube-system/global-pull-secret-syncer-5zqmn","openshift-dns/node-resolver-qfmdc","openshift-image-registry/node-ca-nzctx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal","openshift-multus/multus-additional-cni-plugins-z8k99","openshift-multus/network-metrics-daemon-6xf29"] Jun 11 14:27:47.992533 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.992514 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:47.992620 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.992596 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:47.994689 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.994660 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:47.997052 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997030 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:27:47.997148 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997053 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:27:47.997430 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997256 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:27:47.997430 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997301 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:47.997430 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:27:47.997430 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997317 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7pjgr\"" Jun 11 14:27:47.997430 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:47.997375 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:47.997729 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.997506 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:27:47.999350 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:47.999332 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.001555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.001288 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:27:48.001555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.001515 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.001701 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.001602 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.001701 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.001613 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.003548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.002563 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4njk\"" Jun 11 14:27:48.003930 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.003772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.007307 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.007282 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.007555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.007538 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l2978\"" Jun 11 14:27:48.007617 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.007581 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.007750 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.007731 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:27:48.008999 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.008979 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mtlm7\"" Jun 11 14:27:48.009084 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.009060 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:27:48.009282 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.009265 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.009373 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.009351 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:48.012451 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.012431 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.014417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014361 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014604 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014683 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-cnibin\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014721 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-sys\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014739 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-cni-binary-copy\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014789 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysconfig\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-host\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-tuned\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014844 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-tmp\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdkg6\" (UniqueName: \"kubernetes.io/projected/3979c083-c89f-43d0-85d9-1508c0b0c8c7-kube-api-access-jdkg6\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-socket-dir-parent\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-bin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-system-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-kubernetes\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.015441 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-conf\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.014993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-conf-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015016 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-os-release\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtt26\" (UniqueName: \"kubernetes.io/projected/ffe90b33-7110-407e-9623-73264ab10f0b-kube-api-access-gtt26\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-sys-fs\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015124 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-hostroot\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-registration-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-device-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-run\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015217 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5nn9b\"" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015228 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-etc-kubernetes\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9947l\" (UniqueName: \"kubernetes.io/projected/c980e7c3-2f25-4011-bd98-277a1227e8fa-kube-api-access-9947l\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015325 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.016309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015399 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-lib-modules\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-cnibin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-multus\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-kubelet\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-daemon-config\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015644 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzx49\" (UniqueName: \"kubernetes.io/projected/e872e02e-6c88-41ca-bdc0-b5f449d782bf-kube-api-access-qzx49\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-socket-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrxd8\" (UniqueName: \"kubernetes.io/projected/75f1b07e-6194-4725-b5c2-dda1ac627233-kube-api-access-qrxd8\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-modprobe-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015753 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-os-release\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-k8s-cni-cncf-io\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-netns\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-dbus\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.017145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-systemd\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-var-lib-kubelet\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-multus-certs\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-kubelet-config\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.015999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.016029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.016656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.017707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.016761 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:27:48.018551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.018532 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.018672 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.018543 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dtfct\"" Jun 11 14:27:48.019064 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.019050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.019368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.019273 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8ngxp\"" Jun 11 14:27:48.019470 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.019433 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.019674 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.019655 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:27:48.021459 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.021441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.021570 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.021507 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.021570 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.021524 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.021732 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.021715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:27:48.021820 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.021771 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:27:48.022342 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.022295 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-shlwm\"" Jun 11 14:27:48.024094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.024075 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:27:48.025134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025115 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:27:48.025442 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025425 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:27:48.025530 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025463 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2rhhp\"" Jun 11 14:27:48.025530 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025473 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:27:48.025703 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:27:48.025773 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.025760 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:27:48.044858 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.044839 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqrhc" Jun 11 14:27:48.053971 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.053949 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqrhc" Jun 11 14:27:48.084941 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.084894 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" event={"ID":"70845d2db0c0a6f4effd262e73b56c1c","Type":"ContainerStarted","Data":"0de60ff817f89f6b4a9ec983133d4774fc8e05ca791ad70803fea2f84a1738d5"} Jun 11 14:27:48.086059 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.086033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" event={"ID":"d9aea4a15849b0a3c4984de51c7c9186","Type":"ContainerStarted","Data":"9713cc684283df315419c7ff07c7ee99b4dd86c183e06c715e25ff1cb83744d8"} Jun 11 14:27:48.107248 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.107223 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:27:48.116505 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116484 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-socket-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrxd8\" (UniqueName: \"kubernetes.io/projected/75f1b07e-6194-4725-b5c2-dda1ac627233-kube-api-access-qrxd8\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-modprobe-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-os-release\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-netns\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116600 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2288c2c4-f8f5-427a-8387-324acd363ffc-host-slash\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.116626 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116617 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-systemd-units\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-cni-binary-copy\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-bin\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-socket-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-config\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-host\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116788 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-socket-dir-parent\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-modprobe-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-bin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-host\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-os-release\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116917 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-os-release\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2288c2c4-f8f5-427a-8387-324acd363ffc-iptables-alerter-script\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116947 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovn-node-metrics-cert\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.116977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-system-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.116994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-kubernetes\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-conf\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117072 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-conf-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-netns\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-netns\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-sys-fs\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117136 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-socket-dir-parent\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117154 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-bin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ed7a04-1864-4798-9a59-a2cb2530f330-konnectivity-ca\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117210 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e9d9442-5174-40bf-99a0-c95249deef4f-hosts-file\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-os-release\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-d\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-conf-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-sys-fs\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.117496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtt26\" (UniqueName: \"kubernetes.io/projected/ffe90b33-7110-407e-9623-73264ab10f0b-kube-api-access-gtt26\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117392 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-system-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117418 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-cni-binary-copy\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-kubernetes\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117488 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysctl-conf\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-registration-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117548 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-etc-kubernetes\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-registration-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-lib-modules\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117779 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-cnibin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-daemon-config\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdhkh\" (UniqueName: \"kubernetes.io/projected/c29cf67e-2170-471f-9fd2-0118b1a2c592-kube-api-access-cdhkh\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117885 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.118115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-k8s-cni-cncf-io\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-dbus\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c29cf67e-2170-471f-9fd2-0118b1a2c592-host\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117958 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-env-overrides\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.117973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-systemd\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118014 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-var-lib-kubelet\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-multus-certs\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-kubelet-config\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118139 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-cnibin\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118210 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c29cf67e-2170-471f-9fd2-0118b1a2c592-serviceca\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-cni-dir\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-sys\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118290 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-multus-certs\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ed7a04-1864-4798-9a59-a2cb2530f330-agent-certs\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.118730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-dbus\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-run-k8s-cni-cncf-io\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-systemd\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-var-lib-kubelet\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38d7435d-7499-4de0-8862-b2909e6902be-kubelet-config\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-slash\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-log-socket\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcb4\" (UniqueName: \"kubernetes.io/projected/adcd6aac-75b1-4996-b209-1d2d2f68cac9-kube-api-access-twcb4\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysconfig\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118596 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-tuned\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118600 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-lib-modules\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-tmp\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-cnibin\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118752 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-etc-kubernetes\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118881 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-cnibin\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118901 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-sys\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.119352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118955 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdkg6\" (UniqueName: \"kubernetes.io/projected/3979c083-c89f-43d0-85d9-1508c0b0c8c7-kube-api-access-jdkg6\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.118985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xgb4\" (UniqueName: \"kubernetes.io/projected/2288c2c4-f8f5-427a-8387-324acd363ffc-kube-api-access-9xgb4\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-node-log\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-netd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-systemd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119087 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c980e7c3-2f25-4011-bd98-277a1227e8fa-multus-daemon-config\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-etc-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.119171 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-ovn\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-hostroot\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9d9442-5174-40bf-99a0-c95249deef4f-tmp-dir\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-kubelet\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-device-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-run\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9947l\" (UniqueName: \"kubernetes.io/projected/c980e7c3-2f25-4011-bd98-277a1227e8fa-kube-api-access-9947l\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119452 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-var-lib-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119557 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-multus\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-kubelet\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8r9r\" (UniqueName: \"kubernetes.io/projected/6e9d9442-5174-40bf-99a0-c95249deef4f-kube-api-access-t8r9r\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-script-lib\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.119814 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzx49\" (UniqueName: \"kubernetes.io/projected/e872e02e-6c88-41ca-bdc0-b5f449d782bf-kube-api-access-qzx49\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.120006 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:27:48.619964724 +0000 UTC m=+3.045957409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.120237 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-sysconfig\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.120437 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-hostroot\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.120519 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:48.120624 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.120567 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:27:48.620551456 +0000 UTC m=+3.046544127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:48.121225 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121010 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe90b33-7110-407e-9623-73264ab10f0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.121225 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-device-dir\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.121225 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979c083-c89f-43d0-85d9-1508c0b0c8c7-run\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.121225 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-system-cni-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.121344 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121326 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f1b07e-6194-4725-b5c2-dda1ac627233-etc-selinux\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.121373 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-cni-multus\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.121404 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c980e7c3-2f25-4011-bd98-277a1227e8fa-host-var-lib-kubelet\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.121642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.121527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffe90b33-7110-407e-9623-73264ab10f0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.122372 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.122339 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-tmp\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.122464 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.122424 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979c083-c89f-43d0-85d9-1508c0b0c8c7-etc-tuned\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.125858 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.125827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrxd8\" (UniqueName: \"kubernetes.io/projected/75f1b07e-6194-4725-b5c2-dda1ac627233-kube-api-access-qrxd8\") pod \"aws-ebs-csi-driver-node-qw69s\" (UID: \"75f1b07e-6194-4725-b5c2-dda1ac627233\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.127343 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.127295 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtt26\" (UniqueName: \"kubernetes.io/projected/ffe90b33-7110-407e-9623-73264ab10f0b-kube-api-access-gtt26\") pod \"multus-additional-cni-plugins-z8k99\" (UID: \"ffe90b33-7110-407e-9623-73264ab10f0b\") " pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.128118 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.128095 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:27:48.128213 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.128125 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:27:48.128213 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.128150 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:48.128213 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.128205 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:27:48.628192392 +0000 UTC m=+3.054185046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:48.129843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.129823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdkg6\" (UniqueName: \"kubernetes.io/projected/3979c083-c89f-43d0-85d9-1508c0b0c8c7-kube-api-access-jdkg6\") pod \"tuned-44tnr\" (UID: \"3979c083-c89f-43d0-85d9-1508c0b0c8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.130408 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.130388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzx49\" (UniqueName: \"kubernetes.io/projected/e872e02e-6c88-41ca-bdc0-b5f449d782bf-kube-api-access-qzx49\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.133301 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.133283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9947l\" (UniqueName: \"kubernetes.io/projected/c980e7c3-2f25-4011-bd98-277a1227e8fa-kube-api-access-9947l\") pod \"multus-xm5q5\" (UID: \"c980e7c3-2f25-4011-bd98-277a1227e8fa\") " pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.220264 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-script-lib\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220264 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2288c2c4-f8f5-427a-8387-324acd363ffc-host-slash\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-systemd-units\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-bin\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-config\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-systemd-units\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2288c2c4-f8f5-427a-8387-324acd363ffc-iptables-alerter-script\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-bin\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2288c2c4-f8f5-427a-8387-324acd363ffc-host-slash\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovn-node-metrics-cert\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220476 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-netns\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220508 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ed7a04-1864-4798-9a59-a2cb2530f330-konnectivity-ca\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e9d9442-5174-40bf-99a0-c95249deef4f-hosts-file\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-netns\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220607 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdhkh\" (UniqueName: \"kubernetes.io/projected/c29cf67e-2170-471f-9fd2-0118b1a2c592-kube-api-access-cdhkh\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c29cf67e-2170-471f-9fd2-0118b1a2c592-host\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220678 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e9d9442-5174-40bf-99a0-c95249deef4f-hosts-file\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-env-overrides\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220716 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c29cf67e-2170-471f-9fd2-0118b1a2c592-serviceca\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ed7a04-1864-4798-9a59-a2cb2530f330-agent-certs\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-slash\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-log-socket\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcb4\" (UniqueName: \"kubernetes.io/projected/adcd6aac-75b1-4996-b209-1d2d2f68cac9-kube-api-access-twcb4\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xgb4\" (UniqueName: \"kubernetes.io/projected/2288c2c4-f8f5-427a-8387-324acd363ffc-kube-api-access-9xgb4\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220860 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-node-log\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-netd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.220926 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.220909 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-systemd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-etc-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221078 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-ovn\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221118 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9d9442-5174-40bf-99a0-c95249deef4f-tmp-dir\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221129 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-config\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovnkube-script-lib\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-kubelet\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221129 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2288c2c4-f8f5-427a-8387-324acd363ffc-iptables-alerter-script\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-run-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-cni-netd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-systemd\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67ed7a04-1864-4798-9a59-a2cb2530f330-konnectivity-ca\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221405 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221268 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c29cf67e-2170-471f-9fd2-0118b1a2c592-host\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221456 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-etc-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221503 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e9d9442-5174-40bf-99a0-c95249deef4f-tmp-dir\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221504 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-ovn\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-log-socket\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221567 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-run-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-slash\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221621 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-host-kubelet\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/adcd6aac-75b1-4996-b209-1d2d2f68cac9-env-overrides\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c29cf67e-2170-471f-9fd2-0118b1a2c592-serviceca\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221671 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-node-log\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221727 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-var-lib-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221796 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/adcd6aac-75b1-4996-b209-1d2d2f68cac9-var-lib-openvswitch\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.221972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.221844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8r9r\" (UniqueName: \"kubernetes.io/projected/6e9d9442-5174-40bf-99a0-c95249deef4f-kube-api-access-t8r9r\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.223850 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.223826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67ed7a04-1864-4798-9a59-a2cb2530f330-agent-certs\") pod \"konnectivity-agent-j4j2h\" (UID: \"67ed7a04-1864-4798-9a59-a2cb2530f330\") " pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.225634 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.225614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/adcd6aac-75b1-4996-b209-1d2d2f68cac9-ovn-node-metrics-cert\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.230394 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.230363 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8r9r\" (UniqueName: \"kubernetes.io/projected/6e9d9442-5174-40bf-99a0-c95249deef4f-kube-api-access-t8r9r\") pod \"node-resolver-qfmdc\" (UID: \"6e9d9442-5174-40bf-99a0-c95249deef4f\") " pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.230582 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.230538 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xgb4\" (UniqueName: \"kubernetes.io/projected/2288c2c4-f8f5-427a-8387-324acd363ffc-kube-api-access-9xgb4\") pod \"iptables-alerter-4h55x\" (UID: \"2288c2c4-f8f5-427a-8387-324acd363ffc\") " pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.230655 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.230638 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdhkh\" (UniqueName: \"kubernetes.io/projected/c29cf67e-2170-471f-9fd2-0118b1a2c592-kube-api-access-cdhkh\") pod \"node-ca-nzctx\" (UID: \"c29cf67e-2170-471f-9fd2-0118b1a2c592\") " pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.230925 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.230909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcb4\" (UniqueName: \"kubernetes.io/projected/adcd6aac-75b1-4996-b209-1d2d2f68cac9-kube-api-access-twcb4\") pod \"ovnkube-node-tnknt\" (UID: \"adcd6aac-75b1-4996-b209-1d2d2f68cac9\") " pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.310841 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.310788 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z8k99" Jun 11 14:27:48.318944 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.318748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" Jun 11 14:27:48.329054 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.329024 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-44tnr" Jun 11 14:27:48.334640 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.334619 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xm5q5" Jun 11 14:27:48.343396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.343379 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4h55x" Jun 11 14:27:48.352953 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.352935 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:27:48.360384 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.360365 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qfmdc" Jun 11 14:27:48.366867 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.366850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzctx" Jun 11 14:27:48.374620 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.374603 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:27:48.514943 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.514853 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:48.624467 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.624431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:48.624629 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.624486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:48.624629 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.624589 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:48.624629 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.624592 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:48.624766 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.624645 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:27:49.624629513 +0000 UTC m=+4.050622168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:48.624766 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.624738 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:27:49.624714545 +0000 UTC m=+4.050707208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:48.725913 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:48.725884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:48.726077 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.726028 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:27:48.726077 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.726045 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:27:48.726077 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.726054 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:48.726194 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:48.726104 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:27:49.726092093 +0000 UTC m=+4.152084747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:49.028478 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.028439 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f1b07e_6194_4725_b5c2_dda1ac627233.slice/crio-be4fd50acd3afa4ed085ebad4d4ae0cada0b5c66a207d1a4d51a6dc1d292a84e WatchSource:0}: Error finding container be4fd50acd3afa4ed085ebad4d4ae0cada0b5c66a207d1a4d51a6dc1d292a84e: Status 404 returned error can't find the container with id be4fd50acd3afa4ed085ebad4d4ae0cada0b5c66a207d1a4d51a6dc1d292a84e Jun 11 14:27:49.031452 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.031422 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe90b33_7110_407e_9623_73264ab10f0b.slice/crio-c703e745f964a492c9cee6d843eb379e4530e6d6887d221bfbbd95236f61b909 WatchSource:0}: Error finding container c703e745f964a492c9cee6d843eb379e4530e6d6887d221bfbbd95236f61b909: Status 404 returned error can't find the container with id c703e745f964a492c9cee6d843eb379e4530e6d6887d221bfbbd95236f61b909 Jun 11 14:27:49.032969 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.032950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2288c2c4_f8f5_427a_8387_324acd363ffc.slice/crio-a55a4e2709914ddee1949b0b24ca8f497be193cc6e7891ec091b687c9467d7b4 WatchSource:0}: Error finding container a55a4e2709914ddee1949b0b24ca8f497be193cc6e7891ec091b687c9467d7b4: Status 404 returned error can't find the container with id a55a4e2709914ddee1949b0b24ca8f497be193cc6e7891ec091b687c9467d7b4 Jun 11 14:27:49.034438 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.034420 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc980e7c3_2f25_4011_bd98_277a1227e8fa.slice/crio-2f0372a2d6d2ce932e8a9ef910b90a466ec80fd8ccf77fdf96407db57735cb57 WatchSource:0}: Error finding container 2f0372a2d6d2ce932e8a9ef910b90a466ec80fd8ccf77fdf96407db57735cb57: Status 404 returned error can't find the container with id 2f0372a2d6d2ce932e8a9ef910b90a466ec80fd8ccf77fdf96407db57735cb57 Jun 11 14:27:49.035769 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.035747 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9d9442_5174_40bf_99a0_c95249deef4f.slice/crio-828656494e78223cff93a6bd5f1c2815f533fdfbdf67ae265189bb6a35c98682 WatchSource:0}: Error finding container 828656494e78223cff93a6bd5f1c2815f533fdfbdf67ae265189bb6a35c98682: Status 404 returned error can't find the container with id 828656494e78223cff93a6bd5f1c2815f533fdfbdf67ae265189bb6a35c98682 Jun 11 14:27:49.038899 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.038266 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29cf67e_2170_471f_9fd2_0118b1a2c592.slice/crio-e0b44ba6b36134f96d2b52529f49c928abe5ceb129a6f281c9d991312f734ee1 WatchSource:0}: Error finding container e0b44ba6b36134f96d2b52529f49c928abe5ceb129a6f281c9d991312f734ee1: Status 404 returned error can't find the container with id e0b44ba6b36134f96d2b52529f49c928abe5ceb129a6f281c9d991312f734ee1 Jun 11 14:27:49.038899 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.038826 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcd6aac_75b1_4996_b209_1d2d2f68cac9.slice/crio-967bcf7fa61da49be42beeb2158d258c3d7d0bc1dd6c8a9bf256ea45d7830798 WatchSource:0}: Error finding container 967bcf7fa61da49be42beeb2158d258c3d7d0bc1dd6c8a9bf256ea45d7830798: Status 404 returned error can't find the container with id 967bcf7fa61da49be42beeb2158d258c3d7d0bc1dd6c8a9bf256ea45d7830798 Jun 11 14:27:49.056669 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.056625 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:22:48 +0000 UTC" deadline="2028-01-29 22:20:40.075888741 +0000 UTC" Jun 11 14:27:49.056669 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.056665 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14335h52m51.019226354s" Jun 11 14:27:49.060542 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.060519 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3979c083_c89f_43d0_85d9_1508c0b0c8c7.slice/crio-578694490fa53dac4925488fa6d2090c4a1f51bbdb80360b694c2e0e7b3a709d WatchSource:0}: Error finding container 578694490fa53dac4925488fa6d2090c4a1f51bbdb80360b694c2e0e7b3a709d: Status 404 returned error can't find the container with id 578694490fa53dac4925488fa6d2090c4a1f51bbdb80360b694c2e0e7b3a709d Jun 11 14:27:49.061962 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:27:49.061943 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ed7a04_1864_4798_9a59_a2cb2530f330.slice/crio-edb482dac2f4c86d9fcbf879603a927eb69b645b68f6cb2fcc07c6c10c51d603 WatchSource:0}: Error finding container edb482dac2f4c86d9fcbf879603a927eb69b645b68f6cb2fcc07c6c10c51d603: Status 404 returned error can't find the container with id edb482dac2f4c86d9fcbf879603a927eb69b645b68f6cb2fcc07c6c10c51d603 Jun 11 14:27:49.080431 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.080287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:49.080546 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.080526 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:49.093731 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.093707 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" event={"ID":"75f1b07e-6194-4725-b5c2-dda1ac627233","Type":"ContainerStarted","Data":"be4fd50acd3afa4ed085ebad4d4ae0cada0b5c66a207d1a4d51a6dc1d292a84e"} Jun 11 14:27:49.099490 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.099445 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4j2h" event={"ID":"67ed7a04-1864-4798-9a59-a2cb2530f330","Type":"ContainerStarted","Data":"edb482dac2f4c86d9fcbf879603a927eb69b645b68f6cb2fcc07c6c10c51d603"} Jun 11 14:27:49.100688 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.100667 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzctx" event={"ID":"c29cf67e-2170-471f-9fd2-0118b1a2c592","Type":"ContainerStarted","Data":"e0b44ba6b36134f96d2b52529f49c928abe5ceb129a6f281c9d991312f734ee1"} Jun 11 14:27:49.101818 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.101757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qfmdc" event={"ID":"6e9d9442-5174-40bf-99a0-c95249deef4f","Type":"ContainerStarted","Data":"828656494e78223cff93a6bd5f1c2815f533fdfbdf67ae265189bb6a35c98682"} Jun 11 14:27:49.103723 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.103705 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm5q5" event={"ID":"c980e7c3-2f25-4011-bd98-277a1227e8fa","Type":"ContainerStarted","Data":"2f0372a2d6d2ce932e8a9ef910b90a466ec80fd8ccf77fdf96407db57735cb57"} Jun 11 14:27:49.104812 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.104771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4h55x" event={"ID":"2288c2c4-f8f5-427a-8387-324acd363ffc","Type":"ContainerStarted","Data":"a55a4e2709914ddee1949b0b24ca8f497be193cc6e7891ec091b687c9467d7b4"} Jun 11 14:27:49.105910 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.105890 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-44tnr" event={"ID":"3979c083-c89f-43d0-85d9-1508c0b0c8c7","Type":"ContainerStarted","Data":"578694490fa53dac4925488fa6d2090c4a1f51bbdb80360b694c2e0e7b3a709d"} Jun 11 14:27:49.106972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.106955 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"967bcf7fa61da49be42beeb2158d258c3d7d0bc1dd6c8a9bf256ea45d7830798"} Jun 11 14:27:49.107873 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.107854 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerStarted","Data":"c703e745f964a492c9cee6d843eb379e4530e6d6887d221bfbbd95236f61b909"} Jun 11 14:27:49.378396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.378364 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:49.584575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.584497 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:27:49.633943 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.633906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:49.634111 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.633973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:49.634184 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.634140 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:49.634238 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.634200 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:27:51.634180848 +0000 UTC m=+6.060173517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:49.634589 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.634569 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:49.634680 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.634626 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:27:51.634610447 +0000 UTC m=+6.060603107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:49.735170 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:49.735136 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:49.735340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.735312 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:27:49.735340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.735330 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:27:49.735460 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.735343 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:49.735460 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:49.735397 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:27:51.73538037 +0000 UTC m=+6.161373038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:50.057853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.057762 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:22:48 +0000 UTC" deadline="2027-12-08 11:21:01.076559499 +0000 UTC" Jun 11 14:27:50.057853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.057818 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13076h53m11.018747194s" Jun 11 14:27:50.081994 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.081909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:50.082202 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:50.082030 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:50.082498 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.082305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:50.082498 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:50.082441 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:50.113036 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.112977 2566 generic.go:356] "Generic (PLEG): container finished" podID="70845d2db0c0a6f4effd262e73b56c1c" containerID="c10b61ebb2c4e932cd9972b16a056138178c1e50c6b237aee2933466d96218be" exitCode=0 Jun 11 14:27:50.113198 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.113064 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" event={"ID":"70845d2db0c0a6f4effd262e73b56c1c","Type":"ContainerDied","Data":"c10b61ebb2c4e932cd9972b16a056138178c1e50c6b237aee2933466d96218be"} Jun 11 14:27:50.115622 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.115595 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" event={"ID":"d9aea4a15849b0a3c4984de51c7c9186","Type":"ContainerStarted","Data":"7c61105e8a31ac7a2e730a8dd7e9ad9ac36330d1d9eee090fd9a5058f96a8862"} Jun 11 14:27:50.148094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:50.145399 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-209.ec2.internal" podStartSLOduration=3.145380163 podStartE2EDuration="3.145380163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:50.145131368 +0000 UTC m=+4.571124054" watchObservedRunningTime="2026-06-11 14:27:50.145380163 +0000 UTC m=+4.571372840" Jun 11 14:27:51.080313 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.080282 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:51.080763 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.080416 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:51.142856 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.142817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" event={"ID":"70845d2db0c0a6f4effd262e73b56c1c","Type":"ContainerStarted","Data":"f154914e45a9e8d0a86d53659bd456fcb102dfddb68fe87f791e8e2faeb4a8dd"} Jun 11 14:27:51.163760 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.163358 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-209.ec2.internal" podStartSLOduration=4.163336134 podStartE2EDuration="4.163336134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:27:51.163104721 +0000 UTC m=+5.589097391" watchObservedRunningTime="2026-06-11 14:27:51.163336134 +0000 UTC m=+5.589328814" Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.652545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.652613 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.652888 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.652954 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:27:55.652935844 +0000 UTC m=+10.078928515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.653023 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:51.653396 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.653058 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:27:55.653046549 +0000 UTC m=+10.079039219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:51.753267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:51.753228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:51.753440 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.753429 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:27:51.753518 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.753452 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:27:51.753518 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.753465 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:51.753619 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:51.753527 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:27:55.753509676 +0000 UTC m=+10.179502333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:52.081972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:52.081940 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:52.082466 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:52.082074 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:52.082466 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:52.082375 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:52.082587 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:52.082494 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:53.080811 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:53.080751 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:53.081042 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:53.080949 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:54.085201 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:54.085173 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:54.085682 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:54.085307 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:54.085682 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:54.085657 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:54.085823 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:54.085718 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:55.080921 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:55.080887 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:55.081085 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.081008 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:55.684762 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:55.684703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:55.685214 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:55.685041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:55.686658 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.686628 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:55.686784 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.686713 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:28:03.686692852 +0000 UTC m=+18.112685526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:27:55.690279 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.690088 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:55.690388 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.690330 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:28:03.690310993 +0000 UTC m=+18.116303662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:27:55.786448 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:55.786411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:55.786600 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.786565 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:27:55.786600 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.786586 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:27:55.786600 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.786600 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:55.786709 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:55.786654 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:28:03.786637368 +0000 UTC m=+18.212630029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:27:56.081065 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:56.081034 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:56.081216 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:56.081139 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:56.081625 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:56.081602 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:56.081796 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:56.081719 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:57.080592 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:57.080550 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:57.081152 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:57.080701 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:27:58.080825 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:58.080304 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:27:58.080825 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:58.080329 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:27:58.080825 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:58.080454 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:27:58.080825 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:58.080584 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:27:59.080286 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:27:59.080255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:27:59.080426 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:27:59.080369 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:00.080555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:00.080513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:00.081037 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:00.080570 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:00.081037 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:00.080672 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:00.081037 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:00.080783 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:01.080846 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:01.080816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:01.081276 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:01.080954 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:02.083005 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:02.082976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:02.083346 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:02.083076 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:02.083346 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:02.083126 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:02.083346 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:02.083215 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:03.080288 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:03.080252 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:03.080509 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.080386 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:03.750613 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:03.750574 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:03.751049 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:03.750638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:03.751049 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.750742 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:03.751049 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.750840 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:28:19.750819184 +0000 UTC m=+34.176811856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:03.751049 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.750742 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:03.751049 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.750908 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:28:19.750894087 +0000 UTC m=+34.176886754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:03.851144 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:03.851099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:03.851323 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.851234 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:03.851323 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.851258 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:03.851323 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.851270 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:03.851475 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:03.851339 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:28:19.851319871 +0000 UTC m=+34.277312541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:04.080274 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:04.080240 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:04.080442 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:04.080242 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:04.080442 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:04.080381 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:04.080442 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:04.080423 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:05.080524 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:05.080485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:05.080951 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:05.080602 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:06.083351 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:06.082890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:06.083351 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:06.082923 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:06.083351 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:06.083008 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:06.083351 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:06.083130 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:07.080095 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:07.080059 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:07.080273 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:07.080202 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:08.085093 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:08.085071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:08.085439 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:08.085182 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:08.085551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:08.085532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:08.085654 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:08.085637 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:08.183661 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:08.183302 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzctx" event={"ID":"c29cf67e-2170-471f-9fd2-0118b1a2c592","Type":"ContainerStarted","Data":"4a5b64627bcfaacadef57fdae2d3dddaccf712d8e9731958039e26a378bfbeda"} Jun 11 14:28:09.081065 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.080883 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:09.081230 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:09.081169 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:09.186705 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.186670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4j2h" event={"ID":"67ed7a04-1864-4798-9a59-a2cb2530f330","Type":"ContainerStarted","Data":"bf9db50fd9c47a2302debc9ab7e7b971734abd60ecd589f24e2c3209cd31a07c"} Jun 11 14:28:09.188156 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.188135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qfmdc" event={"ID":"6e9d9442-5174-40bf-99a0-c95249deef4f","Type":"ContainerStarted","Data":"a67af362cf205984caf635ff092535ec68cf900bf2879be658601ce33b23b187"} Jun 11 14:28:09.189483 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.189461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xm5q5" event={"ID":"c980e7c3-2f25-4011-bd98-277a1227e8fa","Type":"ContainerStarted","Data":"5eb32c97efdf05fea0301162c4ee3ad7f1085bb0896ce4d2892662ea05fca179"} Jun 11 14:28:09.191118 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.191085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-44tnr" event={"ID":"3979c083-c89f-43d0-85d9-1508c0b0c8c7","Type":"ContainerStarted","Data":"2a81ff379caa90c99c59657c87cc8c157c1d7fae788b124e06527a910969d316"} Jun 11 14:28:09.193623 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.193607 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:28:09.193944 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.193926 2566 generic.go:356] "Generic (PLEG): container finished" podID="adcd6aac-75b1-4996-b209-1d2d2f68cac9" containerID="118224a7a51dd4f85888416940ea04eecf532706f100cbea313047a258ef9d88" exitCode=1 Jun 11 14:28:09.194025 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.193986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"b5e3c1abf3539c1d45d1597d305a921fe7889ef8c3be28e55d169eb1bd8bb98b"} Jun 11 14:28:09.194083 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.194033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"870ac70cc58f6679ba8831f8927dfc89d20ebd82d359f5594ef385c3ae759a04"} Jun 11 14:28:09.194083 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.194068 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"8a4f845dbb1c5fa2ea51c1ba493dfc14211d3f238b121e243d03300d824c7d5c"} Jun 11 14:28:09.194179 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.194110 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"d405040160c9b3f37a0095b2f3bb222bce1ef2c66edf8b072767e450c67b5df6"} Jun 11 14:28:09.194179 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.194146 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerDied","Data":"118224a7a51dd4f85888416940ea04eecf532706f100cbea313047a258ef9d88"} Jun 11 14:28:09.194263 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.194180 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"3d45d4f3cba45fdd4b7974a0d13a811ee01cf8dee977b2e0689ed498bdb1d220"} Jun 11 14:28:09.195444 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.195425 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="390d42bbf56fa7504f2d37c6aee9afc0af5dd78c15a05d6868dc106f8374de83" exitCode=0 Jun 11 14:28:09.195513 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.195461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"390d42bbf56fa7504f2d37c6aee9afc0af5dd78c15a05d6868dc106f8374de83"} Jun 11 14:28:09.196732 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.196715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" event={"ID":"75f1b07e-6194-4725-b5c2-dda1ac627233","Type":"ContainerStarted","Data":"704d5580059618d37d44e9f9f2dda4a8d82c1f4d7ab2651ed5bb87bd89cf3b6d"} Jun 11 14:28:09.203368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.203336 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j4j2h" podStartSLOduration=4.294318111 podStartE2EDuration="23.203324527s" totalImagesPullingTime="18.909006416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:09.202831677 +0000 UTC m=+23.628824354" watchObservedRunningTime="2026-06-11 14:28:09.203324527 +0000 UTC m=+23.629317236" Jun 11 14:28:09.219909 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.219873 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qfmdc" podStartSLOduration=4.241622375 podStartE2EDuration="23.219858673s" totalImagesPullingTime="18.978236298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:09.219763427 +0000 UTC m=+23.645756103" watchObservedRunningTime="2026-06-11 14:28:09.219858673 +0000 UTC m=+23.645851352" Jun 11 14:28:09.234869 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.234833 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nzctx" podStartSLOduration=4.319694778 podStartE2EDuration="23.234795921s" totalImagesPullingTime="18.915101143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:09.234478867 +0000 UTC m=+23.660471543" watchObservedRunningTime="2026-06-11 14:28:09.234795921 +0000 UTC m=+23.660788598" Jun 11 14:28:09.286887 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.286845 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-44tnr" podStartSLOduration=4.335204735 podStartE2EDuration="23.2868333s" totalImagesPullingTime="18.951628565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:09.286367549 +0000 UTC m=+23.712360238" watchObservedRunningTime="2026-06-11 14:28:09.2868333 +0000 UTC m=+23.712825975" Jun 11 14:28:09.306080 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.306037 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xm5q5" podStartSLOduration=4.317259323 podStartE2EDuration="23.306025116s" totalImagesPullingTime="18.988765793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:09.305874723 +0000 UTC m=+23.731867390" watchObservedRunningTime="2026-06-11 14:28:09.306025116 +0000 UTC m=+23.732017791" Jun 11 14:28:09.483579 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:09.483560 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:28:10.073785 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.073693 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:28:09.483575971Z","UUID":"992c03a2-90d0-48ac-a461-f8886dcc7154","Handler":null,"Name":"","Endpoint":""} Jun 11 14:28:10.075195 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.075176 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:28:10.075303 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.075214 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:28:10.083856 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.083838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:10.083980 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:10.083939 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:10.083980 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.083966 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:10.084062 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:10.084033 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:10.200896 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.200851 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" event={"ID":"75f1b07e-6194-4725-b5c2-dda1ac627233","Type":"ContainerStarted","Data":"d9cfb73be60cfd0aaf8204dc02241a01990a6256a64110251358c346798cc2cb"} Jun 11 14:28:10.202488 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.202460 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4h55x" event={"ID":"2288c2c4-f8f5-427a-8387-324acd363ffc","Type":"ContainerStarted","Data":"14bc7fba50ebb83d638841ee06a11c4321f6f0c9fc495aa851f619536f94f942"} Jun 11 14:28:10.221531 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:10.221483 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4h55x" podStartSLOduration=5.236082228 podStartE2EDuration="24.22146422s" totalImagesPullingTime="18.985381992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:10.220841779 +0000 UTC m=+24.646834454" watchObservedRunningTime="2026-06-11 14:28:10.22146422 +0000 UTC m=+24.647456901" Jun 11 14:28:11.080326 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.080249 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:11.080465 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:11.080364 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:11.207044 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.207011 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" event={"ID":"75f1b07e-6194-4725-b5c2-dda1ac627233","Type":"ContainerStarted","Data":"cabf427f2165131520c8e48610a06d6dec970f7ee3e239f14e92859156214575"} Jun 11 14:28:11.210048 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.210019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:28:11.210413 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.210386 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"8f084f470b8c5ab548d79b83c77f0435feb6684ab2918fc91bbba23653f1cce2"} Jun 11 14:28:11.227114 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.227066 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qw69s" podStartSLOduration=4.2877456259999995 podStartE2EDuration="25.227053143s" totalImagesPullingTime="20.939307517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:11.226589168 +0000 UTC m=+25.652581844" watchObservedRunningTime="2026-06-11 14:28:11.227053143 +0000 UTC m=+25.653045818" Jun 11 14:28:11.930120 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.929928 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:28:11.930593 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:11.930569 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:28:12.080735 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:12.080702 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:12.080939 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:12.080700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:12.080939 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:12.080891 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:12.081034 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:12.081015 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:12.213476 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:12.213404 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:28:12.213933 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:12.213917 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j4j2h" Jun 11 14:28:13.080273 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:13.080238 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:13.080435 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:13.080360 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:14.080331 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:14.080299 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:14.081033 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:14.080435 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:14.081033 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:14.080299 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:14.081033 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:14.080946 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:15.081099 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.080906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:15.081611 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:15.081169 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:15.224047 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.224019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:28:15.224394 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.224368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"20911724b93716d8a3e66900d882146e3aa5b74a1f2bb32afb590ac2287e64b6"} Jun 11 14:28:15.224642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.224618 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:15.224847 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.224817 2566 scope.go:117] "RemoveContainer" containerID="118224a7a51dd4f85888416940ea04eecf532706f100cbea313047a258ef9d88" Jun 11 14:28:15.226433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.226406 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="b0a1fd3138733faa4e05dc42a618f9e7d6dc2c0211683a1bd13494cebfaf6f69" exitCode=0 Jun 11 14:28:15.226526 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.226462 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"b0a1fd3138733faa4e05dc42a618f9e7d6dc2c0211683a1bd13494cebfaf6f69"} Jun 11 14:28:15.242396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:15.242374 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:16.084678 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.084330 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:16.084678 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:16.084498 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:16.085175 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.084685 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:16.085175 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:16.084857 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:16.231841 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.231794 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:28:16.232165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.232138 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" event={"ID":"adcd6aac-75b1-4996-b209-1d2d2f68cac9","Type":"ContainerStarted","Data":"18943955afef0b72a85dcf9deb7ee6774ebeb5ec9e249007d331c8a2f7f598a7"} Jun 11 14:28:16.232470 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.232440 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:16.232557 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.232501 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:16.247716 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.247696 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:16.267724 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.267681 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" podStartSLOduration=11.272791437 podStartE2EDuration="30.267668747s" totalImagesPullingTime="18.99487731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:16.267350108 +0000 UTC m=+30.693342784" watchObservedRunningTime="2026-06-11 14:28:16.267668747 +0000 UTC m=+30.693661423" Jun 11 14:28:16.874406 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.874369 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zqmn"] Jun 11 14:28:16.874584 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.874488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:16.874648 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:16.874596 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:16.875141 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.875122 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bv222"] Jun 11 14:28:16.875229 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.875206 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:16.875324 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:16.875303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:16.875864 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.875840 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xf29"] Jun 11 14:28:16.875955 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:16.875944 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:16.876063 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:16.876044 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:17.236368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:17.236283 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="ec9d2943d11cff5f4c0fcd1e5806916fe78ed4883bd7a43966cfbdddf36f3985" exitCode=0 Jun 11 14:28:17.236695 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:17.236376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"ec9d2943d11cff5f4c0fcd1e5806916fe78ed4883bd7a43966cfbdddf36f3985"} Jun 11 14:28:18.080640 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:18.080459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:18.080826 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:18.080740 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:18.240480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:18.240445 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="ccaa9b7e0426c45473c3dc56ddbda796161a2ffc8eef3ce44e2f1322f0903642" exitCode=0 Jun 11 14:28:18.240938 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:18.240529 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"ccaa9b7e0426c45473c3dc56ddbda796161a2ffc8eef3ce44e2f1322f0903642"} Jun 11 14:28:19.080790 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:19.080758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:19.080970 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:19.080814 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:19.080970 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.080925 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:28:19.081049 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.081001 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv222" podUID="d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef" Jun 11 14:28:19.773504 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:19.773473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:19.774003 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:19.773515 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:19.774003 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.773611 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:19.774003 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.773614 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:19.774003 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.773659 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:28:51.773645612 +0000 UTC m=+66.199638266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:19.774003 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.773672 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret podName:38d7435d-7499-4de0-8862-b2909e6902be nodeName:}" failed. No retries permitted until 2026-06-11 14:28:51.773665293 +0000 UTC m=+66.199657946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret") pod "global-pull-secret-syncer-5zqmn" (UID: "38d7435d-7499-4de0-8862-b2909e6902be") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:19.874499 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:19.874467 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:19.874673 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.874594 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:19.874673 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.874613 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:19.874673 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.874625 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tzmnh for pod openshift-network-diagnostics/network-check-target-bv222: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:19.874673 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:19.874674 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh podName:d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef nodeName:}" failed. No retries permitted until 2026-06-11 14:28:51.874660633 +0000 UTC m=+66.300653301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tzmnh" (UniqueName: "kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh") pod "network-check-target-bv222" (UID: "d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:20.080555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.080481 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:20.080691 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:20.080582 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5zqmn" podUID="38d7435d-7499-4de0-8862-b2909e6902be" Jun 11 14:28:20.873347 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.873286 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-209.ec2.internal" event="NodeReady" Jun 11 14:28:20.873831 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.873399 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:28:20.913143 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.913117 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:28:20.927171 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.927150 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2md4m"] Jun 11 14:28:20.927288 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.927267 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:20.929537 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.929519 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 14:28:20.929914 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.929877 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zlcj\"" Jun 11 14:28:20.930058 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.930040 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 14:28:20.930194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.930177 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 14:28:20.936863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.936845 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 14:28:20.936988 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.936968 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:28:20.937046 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.937011 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5z2bw"] Jun 11 14:28:20.937097 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.937083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:20.939386 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.939030 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:28:20.939386 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.939258 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsmch\"" Jun 11 14:28:20.939593 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.939579 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:28:20.949845 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.949820 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2md4m"] Jun 11 14:28:20.949923 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.949861 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5z2bw"] Jun 11 14:28:20.949923 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.949889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:20.952728 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.952686 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:28:20.953008 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.952990 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:28:20.953153 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.953134 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:28:20.953231 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:20.953172 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vhswp\"" Jun 11 14:28:21.080997 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.080962 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:21.080997 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.080982 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:21.082790 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.082790 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e89735-b15c-4a29-a301-118c61643dd7-tmp-dir\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.082990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.082990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.082990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.082990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.082907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e89735-b15c-4a29-a301-118c61643dd7-config-volume\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.083133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.083133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.083133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.083133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfhn\" (UniqueName: \"kubernetes.io/projected/04f21d6a-eaea-445d-898a-b6e51b31a288-kube-api-access-8pfhn\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.083339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.083339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083171 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66jkb\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.083339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmzf\" (UniqueName: \"kubernetes.io/projected/70e89735-b15c-4a29-a301-118c61643dd7-kube-api-access-jgmzf\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.083339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04f21d6a-eaea-445d-898a-b6e51b31a288-cert\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.083990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.083955 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:28:21.084096 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.084033 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zhnzv\"" Jun 11 14:28:21.084096 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.084068 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:28:21.084178 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.084104 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jqb7\"" Jun 11 14:28:21.084233 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.084215 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:28:21.184750 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.184750 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184720 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfhn\" (UniqueName: \"kubernetes.io/projected/04f21d6a-eaea-445d-898a-b6e51b31a288-kube-api-access-8pfhn\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184787 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184839 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66jkb\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184866 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmzf\" (UniqueName: \"kubernetes.io/projected/70e89735-b15c-4a29-a301-118c61643dd7-kube-api-access-jgmzf\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04f21d6a-eaea-445d-898a-b6e51b31a288-cert\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.184912 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.184948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.184983 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:21.684962278 +0000 UTC m=+36.110954952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:21.185010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185007 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e89735-b15c-4a29-a301-118c61643dd7-tmp-dir\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185046 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185076 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185138 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e89735-b15c-4a29-a301-118c61643dd7-config-volume\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.185178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.185718 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.185621 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:21.185718 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.185637 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:21.185718 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.185694 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:21.685678562 +0000 UTC m=+36.111671238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:21.186048 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.186015 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70e89735-b15c-4a29-a301-118c61643dd7-tmp-dir\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.186173 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.186130 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.186645 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.186590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70e89735-b15c-4a29-a301-118c61643dd7-config-volume\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.187215 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.187195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.189717 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.189696 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.189851 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.189822 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.192280 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.192261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04f21d6a-eaea-445d-898a-b6e51b31a288-cert\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.195398 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.195373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmzf\" (UniqueName: \"kubernetes.io/projected/70e89735-b15c-4a29-a301-118c61643dd7-kube-api-access-jgmzf\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.195492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.195463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfhn\" (UniqueName: \"kubernetes.io/projected/04f21d6a-eaea-445d-898a-b6e51b31a288-kube-api-access-8pfhn\") pod \"ingress-canary-5z2bw\" (UID: \"04f21d6a-eaea-445d-898a-b6e51b31a288\") " pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.195580 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.195519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.195689 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.195671 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66jkb\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.261196 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.261166 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5z2bw" Jun 11 14:28:21.429340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.429161 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5z2bw"] Jun 11 14:28:21.433854 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:21.433827 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f21d6a_eaea_445d_898a_b6e51b31a288.slice/crio-e8c08720598e85495f054e969d71298df5611ba69094df193fb2e4fc2c8acc7d WatchSource:0}: Error finding container e8c08720598e85495f054e969d71298df5611ba69094df193fb2e4fc2c8acc7d: Status 404 returned error can't find the container with id e8c08720598e85495f054e969d71298df5611ba69094df193fb2e4fc2c8acc7d Jun 11 14:28:21.688846 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.688741 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:21.688846 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:21.688781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:21.689154 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.688930 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:21.689154 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.688936 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:21.689154 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.688957 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:21.689154 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.689009 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:22.688991974 +0000 UTC m=+37.114984628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:21.689154 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:21.689024 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:22.689017993 +0000 UTC m=+37.115010647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:22.083759 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:22.083729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:22.086596 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:22.086568 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:28:22.251816 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:22.251762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5z2bw" event={"ID":"04f21d6a-eaea-445d-898a-b6e51b31a288","Type":"ContainerStarted","Data":"e8c08720598e85495f054e969d71298df5611ba69094df193fb2e4fc2c8acc7d"} Jun 11 14:28:22.696216 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:22.696181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:22.696404 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:22.696289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:22.696468 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:22.696417 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:22.696526 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:22.696479 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:24.696452081 +0000 UTC m=+39.122444735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:22.696849 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:22.696820 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:22.696849 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:22.696845 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:22.697022 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:22.696891 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:24.696876947 +0000 UTC m=+39.122869604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:24.712299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:24.712268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:24.712315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:24.712431 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:24.712437 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:24.712459 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:24.712512 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:28.712494277 +0000 UTC m=+43.138486934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:24.712778 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:24.712534 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:28.712524233 +0000 UTC m=+43.138516887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:26.263576 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.263545 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="0b0a948f839e881c17b0b5417ae082da083fde34c47154f2e7ec1f508fe6dd58" exitCode=0 Jun 11 14:28:26.264017 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.263628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"0b0a948f839e881c17b0b5417ae082da083fde34c47154f2e7ec1f508fe6dd58"} Jun 11 14:28:26.265169 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.265147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5z2bw" event={"ID":"04f21d6a-eaea-445d-898a-b6e51b31a288","Type":"ContainerStarted","Data":"f959b83c519314bb46489922c8fe90a69a281ff068500c0129f6652b1bcf22d9"} Jun 11 14:28:26.306187 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.306139 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5z2bw" podStartSLOduration=2.565070261 podStartE2EDuration="6.306118444s" totalImagesPullingTime="3.741048183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:26.306041456 +0000 UTC m=+40.732034132" watchObservedRunningTime="2026-06-11 14:28:26.306118444 +0000 UTC m=+40.732111121" Jun 11 14:28:26.454153 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.454072 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:26.555551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:26.555500 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:27.269779 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:27.269746 2566 generic.go:356] "Generic (PLEG): container finished" podID="ffe90b33-7110-407e-9623-73264ab10f0b" containerID="dc03cbb3884e3a2f271597566fc1a94fe5b5dce8e44bacdf96055ba155a7daf3" exitCode=0 Jun 11 14:28:27.270256 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:27.269832 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerDied","Data":"dc03cbb3884e3a2f271597566fc1a94fe5b5dce8e44bacdf96055ba155a7daf3"} Jun 11 14:28:28.275518 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.275474 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z8k99" event={"ID":"ffe90b33-7110-407e-9623-73264ab10f0b","Type":"ContainerStarted","Data":"27fbd60e7c42304a29d6504bdb68947b6aa45c2b0745b29f65274d4b6990c396"} Jun 11 14:28:28.297480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.297436 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z8k99" podStartSLOduration=9.471335425 podStartE2EDuration="42.297423412s" totalImagesPullingTime="32.826087987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:28.296213412 +0000 UTC m=+42.722206087" watchObservedRunningTime="2026-06-11 14:28:28.297423412 +0000 UTC m=+42.723416094" Jun 11 14:28:28.417239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.417188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:28.518263 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.518233 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:28.745064 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.744970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:28.745064 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:28.745013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:28.745262 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:28.745126 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:28.745262 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:28.745185 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:36.745168525 +0000 UTC m=+51.171161201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:28.745262 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:28.745225 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:28.745262 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:28.745243 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:28.745398 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:28.745288 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:36.745276375 +0000 UTC m=+51.171269066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:32.369437 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:32.369402 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:32.470853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:32.470819 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:33.831012 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:33.830976 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:33.893564 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:33.893516 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:33.989712 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:33.989679 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:34.089244 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:34.089158 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:34.190620 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:34.190585 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:34.301455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:34.301416 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:36.744864 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:36.744828 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:36.793641 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:36.793602 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:36.799764 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:36.799739 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:36.799882 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:36.799842 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:36.799940 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:36.799912 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:36.799940 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:36.799925 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:36.799940 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:36.799930 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:36.800066 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:36.799983 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:52.799969707 +0000 UTC m=+67.225962361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:36.800066 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:36.799995 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:52.799989682 +0000 UTC m=+67.225982336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:37.841706 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:37.841672 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:39.093882 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.093845 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz"] Jun 11 14:28:39.135267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.135232 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2"] Jun 11 14:28:39.135446 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.135326 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.138152 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.138126 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 14:28:39.138152 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.138142 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 14:28:39.138365 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.138233 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 14:28:39.138365 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.138286 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 14:28:39.139046 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.139032 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ptzhd\"" Jun 11 14:28:39.148488 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.148471 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw"] Jun 11 14:28:39.148602 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.148588 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.151021 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.151001 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 14:28:39.151125 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.151030 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 14:28:39.151305 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.151289 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 14:28:39.151557 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.151544 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 14:28:39.162601 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.162583 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz"] Jun 11 14:28:39.162694 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.162606 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2"] Jun 11 14:28:39.162694 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.162620 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw"] Jun 11 14:28:39.162694 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.162679 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.165370 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.165355 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 14:28:39.318661 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318623 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvqwp\" (UniqueName: \"kubernetes.io/projected/3f8219be-2901-41c2-b2d1-c107d75ee390-kube-api-access-dvqwp\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.318901 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.318901 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn8z6\" (UniqueName: \"kubernetes.io/projected/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-kube-api-access-cn8z6\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.318901 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2vp6\" (UniqueName: \"kubernetes.io/projected/b3a72038-d82c-47c2-bf78-e12a14e5deb9-kube-api-access-v2vp6\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.318901 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318877 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.319107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.319107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.319107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.318986 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.319107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.319044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3a72038-d82c-47c2-bf78-e12a14e5deb9-tmp\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.319107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.319082 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3a72038-d82c-47c2-bf78-e12a14e5deb9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.319253 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.319120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f8219be-2901-41c2-b2d1-c107d75ee390-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.399426 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.399341 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:39.420313 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.420455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420320 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.420455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420355 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.420455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.420455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3a72038-d82c-47c2-bf78-e12a14e5deb9-tmp\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.420643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420525 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3a72038-d82c-47c2-bf78-e12a14e5deb9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.420643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f8219be-2901-41c2-b2d1-c107d75ee390-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.420643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvqwp\" (UniqueName: \"kubernetes.io/projected/3f8219be-2901-41c2-b2d1-c107d75ee390-kube-api-access-dvqwp\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.420643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.421002 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.420977 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn8z6\" (UniqueName: \"kubernetes.io/projected/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-kube-api-access-cn8z6\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.421133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.421113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3a72038-d82c-47c2-bf78-e12a14e5deb9-tmp\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.421535 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.421514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2vp6\" (UniqueName: \"kubernetes.io/projected/b3a72038-d82c-47c2-bf78-e12a14e5deb9-kube-api-access-v2vp6\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.422345 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.422325 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.427492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.426065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.427492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.426462 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.427492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.426472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f8219be-2901-41c2-b2d1-c107d75ee390-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.427492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.426681 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.427492 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.427195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-ca\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.428960 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.428939 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b3a72038-d82c-47c2-bf78-e12a14e5deb9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.430642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.430615 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvqwp\" (UniqueName: \"kubernetes.io/projected/3f8219be-2901-41c2-b2d1-c107d75ee390-kube-api-access-dvqwp\") pod \"managed-serviceaccount-addon-agent-bc58844f4-vsrhz\" (UID: \"3f8219be-2901-41c2-b2d1-c107d75ee390\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.431282 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.431261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn8z6\" (UniqueName: \"kubernetes.io/projected/2027d7e6-58c2-48f5-a226-9d4a028ee2f4-kube-api-access-cn8z6\") pod \"cluster-proxy-proxy-agent-7d868d7dd6-t4zb2\" (UID: \"2027d7e6-58c2-48f5-a226-9d4a028ee2f4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.431745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.431716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2vp6\" (UniqueName: \"kubernetes.io/projected/b3a72038-d82c-47c2-bf78-e12a14e5deb9-kube-api-access-v2vp6\") pod \"klusterlet-addon-workmgr-6f58d8985c-ffskw\" (UID: \"b3a72038-d82c-47c2-bf78-e12a14e5deb9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.461748 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.461720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:28:39.469977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.469952 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:28:39.483999 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.483955 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:39.500180 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.500148 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:39.627940 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.627912 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz"] Jun 11 14:28:39.631893 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:39.631857 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f8219be_2901_41c2_b2d1_c107d75ee390.slice/crio-835d5d94f1645526f89bb2579f5ea68f7ebef4ca91599e43156c62c29bc6f1aa WatchSource:0}: Error finding container 835d5d94f1645526f89bb2579f5ea68f7ebef4ca91599e43156c62c29bc6f1aa: Status 404 returned error can't find the container with id 835d5d94f1645526f89bb2579f5ea68f7ebef4ca91599e43156c62c29bc6f1aa Jun 11 14:28:39.634587 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.634528 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2"] Jun 11 14:28:39.638253 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:39.638232 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2027d7e6_58c2_48f5_a226_9d4a028ee2f4.slice/crio-385e420eccdea685b730bd83b4c0d29a0522e45a09a38ab3c572d62c78d6e298 WatchSource:0}: Error finding container 385e420eccdea685b730bd83b4c0d29a0522e45a09a38ab3c572d62c78d6e298: Status 404 returned error can't find the container with id 385e420eccdea685b730bd83b4c0d29a0522e45a09a38ab3c572d62c78d6e298 Jun 11 14:28:39.651193 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:39.651145 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw"] Jun 11 14:28:39.654330 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:39.654290 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a72038_d82c_47c2_bf78_e12a14e5deb9.slice/crio-cb04a5b32c61b90e78517be8757e7cef44bc8b478466c81b44559cdddb1c7edd WatchSource:0}: Error finding container cb04a5b32c61b90e78517be8757e7cef44bc8b478466c81b44559cdddb1c7edd: Status 404 returned error can't find the container with id cb04a5b32c61b90e78517be8757e7cef44bc8b478466c81b44559cdddb1c7edd Jun 11 14:28:40.303678 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:40.303642 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerStarted","Data":"385e420eccdea685b730bd83b4c0d29a0522e45a09a38ab3c572d62c78d6e298"} Jun 11 14:28:40.305001 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:40.304970 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerStarted","Data":"cb04a5b32c61b90e78517be8757e7cef44bc8b478466c81b44559cdddb1c7edd"} Jun 11 14:28:40.306206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:40.306187 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerStarted","Data":"835d5d94f1645526f89bb2579f5ea68f7ebef4ca91599e43156c62c29bc6f1aa"} Jun 11 14:28:46.324987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.324888 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerStarted","Data":"25f0fcf9ceaa365f81c08896ceebfea2c84e41ff7745813b8354603dae8042f8"} Jun 11 14:28:46.326820 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.326781 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerStarted","Data":"d37254a076043cfc4400761bcfb6c01e5128ebbcc5a673cd5da2e584f0a245a3"} Jun 11 14:28:46.326950 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.326836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerStarted","Data":"c6f4d457fc8fb8baa8609c871e4c7ee19935a39b79c3c38c3ac0537b5395f328"} Jun 11 14:28:46.326950 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.326857 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerStarted","Data":"9f3a8335248b91bd52a38ab9fbdc73a629a004baf3dfca63afe545f2b2ccec35"} Jun 11 14:28:46.328135 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.328114 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerStarted","Data":"6dba738516ffe5d33ffa5d71b4cf7c802c9882a4c46307bbde1d7b4811eb6447"} Jun 11 14:28:46.328323 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.328306 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:46.329895 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.329875 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:28:46.342172 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.340174 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" podStartSLOduration=0.947457344 podStartE2EDuration="7.340157482s" totalImagesPullingTime="6.392700138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:46.339167818 +0000 UTC m=+60.765160496" watchObservedRunningTime="2026-06-11 14:28:46.340157482 +0000 UTC m=+60.766150158" Jun 11 14:28:46.356482 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.356437 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" podStartSLOduration=0.917234545 podStartE2EDuration="7.356424225s" totalImagesPullingTime="6.43918968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:46.355579465 +0000 UTC m=+60.781572155" watchObservedRunningTime="2026-06-11 14:28:46.356424225 +0000 UTC m=+60.782416914" Jun 11 14:28:46.370544 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:46.370500 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" podStartSLOduration=0.952608445 podStartE2EDuration="7.3704869s" totalImagesPullingTime="6.417878455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:46.369386372 +0000 UTC m=+60.795379047" watchObservedRunningTime="2026-06-11 14:28:46.3704869 +0000 UTC m=+60.796479576" Jun 11 14:28:48.252119 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:48.252089 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tnknt" Jun 11 14:28:48.403306 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:48.403269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:48.459102 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:48.459065 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:49.981699 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:49.981661 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:50.032541 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:50.032496 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:50.491507 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:50.491468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:50.546463 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:50.546431 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:51.820426 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.820389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:28:51.820836 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.820464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:51.824962 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.824938 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:28:51.824962 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.824958 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:28:51.830855 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:51.830836 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:28:51.830940 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:51.830905 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:29:55.830885388 +0000 UTC m=+130.256878062 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : secret "metrics-daemon-secret" not found Jun 11 14:28:51.833048 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.833027 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38d7435d-7499-4de0-8862-b2909e6902be-original-pull-secret\") pod \"global-pull-secret-syncer-5zqmn\" (UID: \"38d7435d-7499-4de0-8862-b2909e6902be\") " pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:51.921847 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.921787 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:51.924568 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.924549 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:28:51.934559 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.934541 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:28:51.945080 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.945056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzmnh\" (UniqueName: \"kubernetes.io/projected/d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef-kube-api-access-tzmnh\") pod \"network-check-target-bv222\" (UID: \"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef\") " pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:51.997684 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:51.997658 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zhnzv\"" Jun 11 14:28:52.005870 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.005851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:52.095539 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.095511 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zqmn" Jun 11 14:28:52.132429 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.132404 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bv222"] Jun 11 14:28:52.136545 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:52.136503 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1be409e_d3c7_4c2e_9d44_eca2fe1ec9ef.slice/crio-a19b85f340992e0e29b0b4e8c5b61382432207c01d03aa86d19e92a7e0fe55a7 WatchSource:0}: Error finding container a19b85f340992e0e29b0b4e8c5b61382432207c01d03aa86d19e92a7e0fe55a7: Status 404 returned error can't find the container with id a19b85f340992e0e29b0b4e8c5b61382432207c01d03aa86d19e92a7e0fe55a7 Jun 11 14:28:52.201371 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.201335 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:52.219255 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.219223 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zqmn"] Jun 11 14:28:52.223210 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:28:52.223183 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d7435d_7499_4de0_8862_b2909e6902be.slice/crio-4f62342f7cc3733f88abf606a0e1d907dc93babf8ca70c4aab035a1faaabbede WatchSource:0}: Error finding container 4f62342f7cc3733f88abf606a0e1d907dc93babf8ca70c4aab035a1faaabbede: Status 404 returned error can't find the container with id 4f62342f7cc3733f88abf606a0e1d907dc93babf8ca70c4aab035a1faaabbede Jun 11 14:28:52.308797 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.308762 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:52.347271 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.347194 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bv222" event={"ID":"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef","Type":"ContainerStarted","Data":"a19b85f340992e0e29b0b4e8c5b61382432207c01d03aa86d19e92a7e0fe55a7"} Jun 11 14:28:52.348221 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.348200 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zqmn" event={"ID":"38d7435d-7499-4de0-8862-b2909e6902be","Type":"ContainerStarted","Data":"4f62342f7cc3733f88abf606a0e1d907dc93babf8ca70c4aab035a1faaabbede"} Jun 11 14:28:52.829111 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.829071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:52.829134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:52.829251 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:52.829362 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:24.829340856 +0000 UTC m=+99.255333533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:52.829254 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:52.829414 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:28:52.829502 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:28:52.829464 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:24.829448726 +0000 UTC m=+99.255441394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:28:53.200299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:53.200215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:53.257181 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:53.257144 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:53.469241 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:53.469164 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:53.529163 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:53.529127 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:28:55.360056 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:55.359959 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bv222" event={"ID":"d1be409e-d3c7-4c2e-9d44-eca2fe1ec9ef","Type":"ContainerStarted","Data":"fe5e2852d07874a766b97ef44ef001c2696ca3f35050ec4b44b150d9bab3dee6"} Jun 11 14:28:55.360454 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:55.360085 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:28:58.370818 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:58.370756 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zqmn" event={"ID":"38d7435d-7499-4de0-8862-b2909e6902be","Type":"ContainerStarted","Data":"974f7ff9c4088ec6a8e94a92c5ef2bc5a7dc9d15c8860a532751e76426564812"} Jun 11 14:28:58.385001 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:58.384950 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5zqmn" podStartSLOduration=66.974254986 podStartE2EDuration="1m12.384934322s" totalImagesPullingTime="5.410679336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:58.384843619 +0000 UTC m=+72.810836297" watchObservedRunningTime="2026-06-11 14:28:58.384934322 +0000 UTC m=+72.810926997" Jun 11 14:28:58.385461 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:28:58.385427 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bv222" podStartSLOduration=69.469700101 podStartE2EDuration="1m12.385412073s" totalImagesPullingTime="2.915711972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:55.375050845 +0000 UTC m=+69.801043523" watchObservedRunningTime="2026-06-11 14:28:58.385412073 +0000 UTC m=+72.811404782" Jun 11 14:29:04.906693 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:04.906649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:04.983183 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:04.983152 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:11.977731 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:11.977700 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:12.054534 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:12.054495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:13.407117 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:13.407082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:13.507730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:13.507699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:13.566625 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:13.566590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:24.862666 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:24.862628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:29:24.862666 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:24.862671 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:29:24.863340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:24.862793 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:29:24.863340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:24.862796 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:29:24.863340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:24.862904 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:30:28.862880862 +0000 UTC m=+163.288873534 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:29:24.863340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:24.862822 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:29:24.863340 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:24.862956 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:30:28.862944976 +0000 UTC m=+163.288937630 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:29:26.046029 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:26.045996 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:29:26.366522 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:26.366436 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bv222" Jun 11 14:29:55.883401 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:29:55.883348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:29:55.883930 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:55.883506 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:29:55.883930 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:29:55.883586 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs podName:e872e02e-6c88-41ca-bdc0-b5f449d782bf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:57.883565877 +0000 UTC m=+252.309558536 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs") pod "network-metrics-daemon-6xf29" (UID: "e872e02e-6c88-41ca-bdc0-b5f449d782bf") : secret "metrics-daemon-secret" not found Jun 11 14:30:23.938921 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:23.938862 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" Jun 11 14:30:23.947113 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:23.947081 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2md4m" podUID="70e89735-b15c-4a29-a301-118c61643dd7" Jun 11 14:30:24.090532 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:24.090491 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6xf29" podUID="e872e02e-6c88-41ca-bdc0-b5f449d782bf" Jun 11 14:30:24.622299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:24.622270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:30:24.622464 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:24.622270 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2md4m" Jun 11 14:30:28.931241 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:28.931145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:30:28.931241 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:28.931194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:30:28.931742 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:28.931302 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:30:28.931742 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:28.931313 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfd46c4cc-ht8wj: secret "image-registry-tls" not found Jun 11 14:30:28.931742 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:28.931310 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:30:28.931742 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:28.931364 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls podName:320d1e22-bf1a-4c0a-9be2-b094121557b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:32:30.931351274 +0000 UTC m=+285.357343940 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls") pod "image-registry-5bfd46c4cc-ht8wj" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5") : secret "image-registry-tls" not found Jun 11 14:30:28.931742 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:30:28.931391 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls podName:70e89735-b15c-4a29-a301-118c61643dd7 nodeName:}" failed. No retries permitted until 2026-06-11 14:32:30.931371172 +0000 UTC m=+285.357363841 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls") pod "dns-default-2md4m" (UID: "70e89735-b15c-4a29-a301-118c61643dd7") : secret "dns-default-metrics-tls" not found Jun 11 14:30:38.081039 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:38.081002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:30:44.291691 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:44.291655 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:30:46.328599 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.328558 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" podUID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused" Jun 11 14:30:46.687257 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.687226 2566 generic.go:356] "Generic (PLEG): container finished" podID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" containerID="6dba738516ffe5d33ffa5d71b4cf7c802c9882a4c46307bbde1d7b4811eb6447" exitCode=1 Jun 11 14:30:46.687417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.687307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerDied","Data":"6dba738516ffe5d33ffa5d71b4cf7c802c9882a4c46307bbde1d7b4811eb6447"} Jun 11 14:30:46.687641 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.687615 2566 scope.go:117] "RemoveContainer" containerID="6dba738516ffe5d33ffa5d71b4cf7c802c9882a4c46307bbde1d7b4811eb6447" Jun 11 14:30:46.688782 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.688749 2566 generic.go:356] "Generic (PLEG): container finished" podID="3f8219be-2901-41c2-b2d1-c107d75ee390" containerID="25f0fcf9ceaa365f81c08896ceebfea2c84e41ff7745813b8354603dae8042f8" exitCode=255 Jun 11 14:30:46.688889 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.688777 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerDied","Data":"25f0fcf9ceaa365f81c08896ceebfea2c84e41ff7745813b8354603dae8042f8"} Jun 11 14:30:46.689110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:46.689094 2566 scope.go:117] "RemoveContainer" containerID="25f0fcf9ceaa365f81c08896ceebfea2c84e41ff7745813b8354603dae8042f8" Jun 11 14:30:47.693376 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:47.693340 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerStarted","Data":"8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66"} Jun 11 14:30:47.693854 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:47.693682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:30:47.694246 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:47.694226 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:30:47.695254 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:30:47.695236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerStarted","Data":"4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e"} Jun 11 14:31:11.619229 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:11.619190 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:11.674549 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:11.674513 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:13.336023 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:13.335983 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:13.393337 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:13.393309 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:15.278867 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:15.278830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:15.335239 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:15.335207 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.252755 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.252718 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.343409 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.343373 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.576851 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.576826 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.680303 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.680273 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.772227 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.772195 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.873457 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.873371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:17.976686 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:17.976653 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:18.035570 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:18.035544 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:18.769529 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:18.769499 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:18.865133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:18.865101 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:19.635086 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:19.635052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:19.692269 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:19.692244 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:19.696844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:19.696825 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qfmdc_6e9d9442-5174-40bf-99a0-c95249deef4f/dns-node-resolver/0.log" Jun 11 14:31:20.499292 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:20.499266 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzctx_c29cf67e-2170-471f-9fd2-0118b1a2c592/node-ca/0.log" Jun 11 14:31:20.589389 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:20.589358 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:21.097457 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:21.097432 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5z2bw_04f21d6a-eaea-445d-898a-b6e51b31a288/serve-healthcheck-canary/0.log" Jun 11 14:31:21.918118 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:21.918082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:22.222319 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:22.222238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:22.322569 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:22.322538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:22.426105 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:22.426076 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:22.523194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:22.523165 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:22.623658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:22.623626 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:23.428078 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:23.428048 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:23.825249 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:23.825211 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:24.017922 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:24.017882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:24.180898 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:24.180788 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:24.443390 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:24.443294 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:25.012031 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:25.011997 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:25.620504 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:25.620473 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:25.719535 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:25.719504 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:25.821506 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:25.821474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:25.920863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:25.920769 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:26.214791 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:26.214712 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:26.430863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:26.430830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:26.817532 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:26.817500 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:27.423269 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:27.423231 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:28.038168 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:28.038130 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:28.220721 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:28.220688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:28.428776 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:28.428689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:28.493269 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:28.493235 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:28.868977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:28.868938 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:29.627713 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:29.627673 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:29.863253 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:29.863216 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:30.212342 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:30.212307 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:30.422400 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:30.422355 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:30.664317 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:30.664290 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:30.828396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:30.828362 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:31.427693 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:31.427655 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:31.692657 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:31.692568 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:32.014206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:32.014179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:32.209295 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:32.209257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:32.421332 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:32.421234 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:32.633394 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:32.633360 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:36.750121 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:36.750080 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:38.093735 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:38.093699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:44.272323 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.272289 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gxqwr"] Jun 11 14:31:44.275424 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.275400 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.278708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.278686 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wgv5n\"" Jun 11 14:31:44.279776 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.279752 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:31:44.279776 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.279771 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:31:44.279931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.279755 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:31:44.279931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.279766 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:31:44.298012 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.297990 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxqwr"] Jun 11 14:31:44.323347 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.323318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:44.376607 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.376577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32328d03-ee80-44e4-97db-231ed4f5f197-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.376740 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.376645 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32328d03-ee80-44e4-97db-231ed4f5f197-data-volume\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.376740 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.376686 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32328d03-ee80-44e4-97db-231ed4f5f197-crio-socket\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.376862 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.376733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvpvj\" (UniqueName: \"kubernetes.io/projected/32328d03-ee80-44e4-97db-231ed4f5f197-kube-api-access-fvpvj\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.376862 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.376792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32328d03-ee80-44e4-97db-231ed4f5f197-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.429224 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.429188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:44.477707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477678 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvpvj\" (UniqueName: \"kubernetes.io/projected/32328d03-ee80-44e4-97db-231ed4f5f197-kube-api-access-fvpvj\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.477872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477712 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32328d03-ee80-44e4-97db-231ed4f5f197-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.477872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477754 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32328d03-ee80-44e4-97db-231ed4f5f197-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.477872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477852 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32328d03-ee80-44e4-97db-231ed4f5f197-data-volume\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.478032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477880 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32328d03-ee80-44e4-97db-231ed4f5f197-crio-socket\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.478032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.477979 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32328d03-ee80-44e4-97db-231ed4f5f197-crio-socket\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.478223 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.478201 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32328d03-ee80-44e4-97db-231ed4f5f197-data-volume\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.478332 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.478315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32328d03-ee80-44e4-97db-231ed4f5f197-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.480262 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.480246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32328d03-ee80-44e4-97db-231ed4f5f197-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.488591 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.488569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvpvj\" (UniqueName: \"kubernetes.io/projected/32328d03-ee80-44e4-97db-231ed4f5f197-kube-api-access-fvpvj\") pod \"insights-runtime-extractor-gxqwr\" (UID: \"32328d03-ee80-44e4-97db-231ed4f5f197\") " pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.585109 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.585035 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxqwr" Jun 11 14:31:44.711365 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.711335 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxqwr"] Jun 11 14:31:44.715176 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:31:44.715145 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32328d03_ee80_44e4_97db_231ed4f5f197.slice/crio-8e54d814f5d0c0bee2ff9228e3413da77c6038760eafa6a5aa5088cbfecd468c WatchSource:0}: Error finding container 8e54d814f5d0c0bee2ff9228e3413da77c6038760eafa6a5aa5088cbfecd468c: Status 404 returned error can't find the container with id 8e54d814f5d0c0bee2ff9228e3413da77c6038760eafa6a5aa5088cbfecd468c Jun 11 14:31:44.858659 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.858579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxqwr" event={"ID":"32328d03-ee80-44e4-97db-231ed4f5f197","Type":"ContainerStarted","Data":"83264b004a3fcb86f7feb125b4a8de2ff9c0c1fef8a355e96813263d785727a2"} Jun 11 14:31:44.858659 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:44.858632 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxqwr" event={"ID":"32328d03-ee80-44e4-97db-231ed4f5f197","Type":"ContainerStarted","Data":"8e54d814f5d0c0bee2ff9228e3413da77c6038760eafa6a5aa5088cbfecd468c"} Jun 11 14:31:45.863935 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:45.863897 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxqwr" event={"ID":"32328d03-ee80-44e4-97db-231ed4f5f197","Type":"ContainerStarted","Data":"9ab3af5e9b365c1024dc71be60cd21d1f7baf4b7919d8336135dc914b715b4ea"} Jun 11 14:31:47.667283 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.667243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:47.807795 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.807768 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:47.872311 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.872283 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxqwr" event={"ID":"32328d03-ee80-44e4-97db-231ed4f5f197","Type":"ContainerStarted","Data":"4a49f1ae4a38bfe1f3dbb08f8bfb739e8b4a9c6469e417837ef22907df919a10"} Jun 11 14:31:47.896542 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.896489 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gxqwr" podStartSLOduration=1.7216845680000001 podStartE2EDuration="3.896474549s" totalImagesPullingTime="2.174789981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:31:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:47.896201473 +0000 UTC m=+242.322194170" watchObservedRunningTime="2026-06-11 14:31:47.896474549 +0000 UTC m=+242.322467224" Jun 11 14:31:47.908154 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.908123 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:47.980600 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:47.980516 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:48.432085 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:48.432058 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:48.491808 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:48.491775 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:50.865899 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:50.865859 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:50.932200 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:50.932171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:51.030129 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:51.030094 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:52.832390 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:52.832356 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.033571 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.033531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.251498 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.251469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.319469 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.319404 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5w9gl"] Jun 11 14:31:55.322597 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.322582 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.325399 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.325375 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:31:55.325609 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.325591 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xdft2\"" Jun 11 14:31:55.326415 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.326393 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:31:55.326528 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.326453 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:31:55.326614 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.326599 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:31:55.332147 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.332123 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:31:55.332350 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.332338 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:31:55.360081 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360059 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-metrics-client-ca\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360197 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tpj7\" (UniqueName: \"kubernetes.io/projected/fcf98f86-36b8-4319-8756-e26763367f1d-kube-api-access-8tpj7\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360197 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-root\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360307 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-wtmp\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360307 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360229 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360307 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-textfile\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-sys\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.360417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.360398 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.388904 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.388872 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.461531 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-root\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461628 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-wtmp\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461628 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461628 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461628 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461614 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-root\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461628 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-textfile\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461669 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-wtmp\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461670 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-sys\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcf98f86-36b8-4319-8756-e26763367f1d-sys\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461722 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-metrics-client-ca\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461768 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tpj7\" (UniqueName: \"kubernetes.io/projected/fcf98f86-36b8-4319-8756-e26763367f1d-kube-api-access-8tpj7\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.461907 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:31:55.461855 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 14:31:55.462354 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:31:55.461918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls podName:fcf98f86-36b8-4319-8756-e26763367f1d nodeName:}" failed. No retries permitted until 2026-06-11 14:31:55.961899837 +0000 UTC m=+250.387892491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls") pod "node-exporter-5w9gl" (UID: "fcf98f86-36b8-4319-8756-e26763367f1d") : secret "node-exporter-tls" not found Jun 11 14:31:55.462354 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.461941 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-textfile\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.462354 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.462301 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-metrics-client-ca\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.462354 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.462332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.464018 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.463995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.475147 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.475128 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tpj7\" (UniqueName: \"kubernetes.io/projected/fcf98f86-36b8-4319-8756-e26763367f1d-kube-api-access-8tpj7\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.479617 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.479591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.579451 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.579369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.680395 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.680357 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.786212 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.786179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.881826 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.881731 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:55.966603 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.966571 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:55.968950 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:55.968931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcf98f86-36b8-4319-8756-e26763367f1d-node-exporter-tls\") pod \"node-exporter-5w9gl\" (UID: \"fcf98f86-36b8-4319-8756-e26763367f1d\") " pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:56.132053 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.131957 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:56.231288 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.231255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5w9gl" Jun 11 14:31:56.241923 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:31:56.241895 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf98f86_36b8_4319_8756_e26763367f1d.slice/crio-3bd916c44d4d7e848b7c5e684487edcd46fc555efee21531f7be74f30a03c1b5 WatchSource:0}: Error finding container 3bd916c44d4d7e848b7c5e684487edcd46fc555efee21531f7be74f30a03c1b5: Status 404 returned error can't find the container with id 3bd916c44d4d7e848b7c5e684487edcd46fc555efee21531f7be74f30a03c1b5 Jun 11 14:31:56.322049 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.322011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:56.426551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.426461 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:56.833632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.833592 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:56.901124 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:56.901093 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5w9gl" event={"ID":"fcf98f86-36b8-4319-8756-e26763367f1d","Type":"ContainerStarted","Data":"3bd916c44d4d7e848b7c5e684487edcd46fc555efee21531f7be74f30a03c1b5"} Jun 11 14:31:57.342174 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.342134 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:57.571231 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.571192 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:57.708956 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.708927 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:57.813281 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.813249 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:57.905742 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.905654 2566 generic.go:356] "Generic (PLEG): container finished" podID="fcf98f86-36b8-4319-8756-e26763367f1d" containerID="242d5467fcc4a03dd3e60bf3a30b74a9e201bbea064001c8186041c141256e49" exitCode=0 Jun 11 14:31:57.905742 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.905706 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5w9gl" event={"ID":"fcf98f86-36b8-4319-8756-e26763367f1d","Type":"ContainerDied","Data":"242d5467fcc4a03dd3e60bf3a30b74a9e201bbea064001c8186041c141256e49"} Jun 11 14:31:57.981589 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.981559 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:57.982546 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.982521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:31:57.984931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:57.984902 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e872e02e-6c88-41ca-bdc0-b5f449d782bf-metrics-certs\") pod \"network-metrics-daemon-6xf29\" (UID: \"e872e02e-6c88-41ca-bdc0-b5f449d782bf\") " pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:31:58.080407 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.080374 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.184847 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.184750 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jqb7\"" Jun 11 14:31:58.192946 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.192925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6xf29" Jun 11 14:31:58.218231 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.218199 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.319151 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.319109 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.319330 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.319204 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6xf29"] Jun 11 14:31:58.321922 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:31:58.321896 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode872e02e_6c88_41ca_bdc0_b5f449d782bf.slice/crio-c7767a79474bb343dc5b9547a79e55ef9dc0f647f20caa8baaa7f6ad6dcea079 WatchSource:0}: Error finding container c7767a79474bb343dc5b9547a79e55ef9dc0f647f20caa8baaa7f6ad6dcea079: Status 404 returned error can't find the container with id c7767a79474bb343dc5b9547a79e55ef9dc0f647f20caa8baaa7f6ad6dcea079 Jun 11 14:31:58.506087 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.506051 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.613571 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.613540 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.795231 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.795148 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.910152 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.910118 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xf29" event={"ID":"e872e02e-6c88-41ca-bdc0-b5f449d782bf","Type":"ContainerStarted","Data":"c7767a79474bb343dc5b9547a79e55ef9dc0f647f20caa8baaa7f6ad6dcea079"} Jun 11 14:31:58.912052 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.912027 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5w9gl" event={"ID":"fcf98f86-36b8-4319-8756-e26763367f1d","Type":"ContainerStarted","Data":"baff4ea79b145082ddf3ef4364a501288a2ed3892217d146f5db126bef9f70e2"} Jun 11 14:31:58.912194 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.912067 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5w9gl" event={"ID":"fcf98f86-36b8-4319-8756-e26763367f1d","Type":"ContainerStarted","Data":"55bf1f19af8dbec960d20f1b9a938cf810c53162cf09ba74c6c2389614357746"} Jun 11 14:31:58.951965 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.951925 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:58.960033 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:58.959985 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5w9gl" podStartSLOduration=3.055805186 podStartE2EDuration="3.959967169s" totalImagesPullingTime="832.95207ms" totalInitContainerRuntime="71.209913ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:58.959071009 +0000 UTC m=+253.385063705" watchObservedRunningTime="2026-06-11 14:31:58.959967169 +0000 UTC m=+253.385959875" Jun 11 14:31:59.064308 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.064209 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:59.178449 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.178411 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:59.332419 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.332392 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:31:59.917658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.917624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xf29" event={"ID":"e872e02e-6c88-41ca-bdc0-b5f449d782bf","Type":"ContainerStarted","Data":"8e0246afb1c2c5a7da6ab363c16a98bb427eade061d54836ad9b01330995f2fe"} Jun 11 14:31:59.918082 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.917673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6xf29" event={"ID":"e872e02e-6c88-41ca-bdc0-b5f449d782bf","Type":"ContainerStarted","Data":"7db4b79d9b8db7ccdfcd07ac2fd86decc147fd20342cf90f586d8fecc5aad733"} Jun 11 14:31:59.948255 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:31:59.948188 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6xf29" podStartSLOduration=253.102062713 podStartE2EDuration="4m13.94816817s" totalImagesPullingTime="846.105457ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:59.948056486 +0000 UTC m=+254.374049162" watchObservedRunningTime="2026-06-11 14:31:59.94816817 +0000 UTC m=+254.374160847" Jun 11 14:32:00.051480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:00.051441 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:00.193905 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:00.193787 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:00.342279 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:00.342253 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:00.448408 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:00.448324 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:01.617485 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:01.617446 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:01.869305 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:01.869221 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:03.379183 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:03.379153 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:03.479487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:03.479451 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:05.820452 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:05.820416 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:05.921047 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:05.921018 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:06.765606 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:06.765577 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:06.864601 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:06.864558 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:12.178592 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:12.178552 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:16.185554 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:16.185502 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:16.285841 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:16.285793 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:21.766677 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:21.766634 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:21.840979 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:21.840938 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:24.266496 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:24.266463 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:24.324407 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:24.324370 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:25.252429 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:25.252394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:25.336124 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:25.336088 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:25.592869 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:25.592782 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:25.667201 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:25.667163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:27.622818 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:27.622772 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" Jun 11 14:32:27.622818 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:27.622770 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2md4m" podUID="70e89735-b15c-4a29-a301-118c61643dd7" Jun 11 14:32:28.004944 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:28.004857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:28.005097 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:28.004857 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:28.160439 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:28.160395 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:28.228402 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:28.228371 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:29.471077 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:29.471041 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" podUID="2027d7e6-58c2-48f5-a226-9d4a028ee2f4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:32:30.935354 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:30.935304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:30.935738 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:30.935377 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:30.937777 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:30.937756 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70e89735-b15c-4a29-a301-118c61643dd7-metrics-tls\") pod \"dns-default-2md4m\" (UID: \"70e89735-b15c-4a29-a301-118c61643dd7\") " pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:30.937936 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:30.937918 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"image-registry-5bfd46c4cc-ht8wj\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:31.009623 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.009589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zlcj\"" Jun 11 14:32:31.009623 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.009589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsmch\"" Jun 11 14:32:31.016479 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.016461 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:31.016579 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.016557 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:31.162774 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.162746 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:32:31.167614 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:32:31.167589 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320d1e22_bf1a_4c0a_9be2_b094121557b5.slice/crio-36476fc6059700d0891735a395666bd5166c3cba2652f0609438c344ad8fc31b WatchSource:0}: Error finding container 36476fc6059700d0891735a395666bd5166c3cba2652f0609438c344ad8fc31b: Status 404 returned error can't find the container with id 36476fc6059700d0891735a395666bd5166c3cba2652f0609438c344ad8fc31b Jun 11 14:32:31.177566 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:31.177543 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2md4m"] Jun 11 14:32:31.181155 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:32:31.181133 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e89735_b15c_4a29_a301_118c61643dd7.slice/crio-68ba7fd355ddfc7ad5e567a86cff0854e5e571e61f40a696fc876184feafc862 WatchSource:0}: Error finding container 68ba7fd355ddfc7ad5e567a86cff0854e5e571e61f40a696fc876184feafc862: Status 404 returned error can't find the container with id 68ba7fd355ddfc7ad5e567a86cff0854e5e571e61f40a696fc876184feafc862 Jun 11 14:32:32.018345 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.018307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2md4m" event={"ID":"70e89735-b15c-4a29-a301-118c61643dd7","Type":"ContainerStarted","Data":"68ba7fd355ddfc7ad5e567a86cff0854e5e571e61f40a696fc876184feafc862"} Jun 11 14:32:32.019975 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.019941 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" event={"ID":"320d1e22-bf1a-4c0a-9be2-b094121557b5","Type":"ContainerStarted","Data":"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98"} Jun 11 14:32:32.020118 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.019985 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" event={"ID":"320d1e22-bf1a-4c0a-9be2-b094121557b5","Type":"ContainerStarted","Data":"36476fc6059700d0891735a395666bd5166c3cba2652f0609438c344ad8fc31b"} Jun 11 14:32:32.020118 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.020018 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:32.042631 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.042571 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" podStartSLOduration=286.042549933 podStartE2EDuration="4m46.042549933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:32.041182507 +0000 UTC m=+286.467175196" watchObservedRunningTime="2026-06-11 14:32:32.042549933 +0000 UTC m=+286.468542611" Jun 11 14:32:32.342786 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:32.342686 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:33.024854 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:33.024823 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2md4m" event={"ID":"70e89735-b15c-4a29-a301-118c61643dd7","Type":"ContainerStarted","Data":"472e3eefbca95618fcd8693eac3c0ed410cacbc9909b4988e219c6fc5a8bc036"} Jun 11 14:32:33.025243 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:33.024872 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2md4m" event={"ID":"70e89735-b15c-4a29-a301-118c61643dd7","Type":"ContainerStarted","Data":"b1d8952169b7942eab4d5f4fe1d2e3aaa6df5715e62839369d0f716bede0c865"} Jun 11 14:32:33.025243 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:33.025021 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:33.044702 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:33.044622 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2md4m" podStartSLOduration=251.555415476 podStartE2EDuration="4m13.044603526s" totalImagesPullingTime="1.48918805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:33.043962696 +0000 UTC m=+287.469955371" watchObservedRunningTime="2026-06-11 14:32:33.044603526 +0000 UTC m=+287.470596287" Jun 11 14:32:34.700472 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:34.700439 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:34.758844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:34.758791 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:39.471416 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:39.471379 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" podUID="2027d7e6-58c2-48f5-a226-9d4a028ee2f4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:32:43.033639 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:43.033612 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2md4m" Jun 11 14:32:44.122697 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:44.122662 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:44.196881 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:44.196846 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:46.016755 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:46.016728 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:32:46.019408 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:46.019383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:32:46.023340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:46.023319 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:32:47.074560 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.074483 2566 generic.go:356] "Generic (PLEG): container finished" podID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" containerID="8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66" exitCode=1 Jun 11 14:32:47.075076 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.074564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerDied","Data":"8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66"} Jun 11 14:32:47.075076 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.074639 2566 scope.go:117] "RemoveContainer" containerID="6dba738516ffe5d33ffa5d71b4cf7c802c9882a4c46307bbde1d7b4811eb6447" Jun 11 14:32:47.075076 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.074956 2566 scope.go:117] "RemoveContainer" containerID="8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66" Jun 11 14:32:47.075236 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:47.075127 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f58d8985c-ffskw_open-cluster-management-agent-addon(b3a72038-d82c-47c2-bf78-e12a14e5deb9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" podUID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" Jun 11 14:32:47.076457 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.076436 2566 generic.go:356] "Generic (PLEG): container finished" podID="3f8219be-2901-41c2-b2d1-c107d75ee390" containerID="4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e" exitCode=255 Jun 11 14:32:47.076530 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.076505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerDied","Data":"4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e"} Jun 11 14:32:47.076768 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.076756 2566 scope.go:117] "RemoveContainer" containerID="4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e" Jun 11 14:32:47.076912 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:47.076896 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-bc58844f4-vsrhz_open-cluster-management-agent-addon(3f8219be-2901-41c2-b2d1-c107d75ee390)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" podUID="3f8219be-2901-41c2-b2d1-c107d75ee390" Jun 11 14:32:47.087157 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.087138 2566 scope.go:117] "RemoveContainer" containerID="25f0fcf9ceaa365f81c08896ceebfea2c84e41ff7745813b8354603dae8042f8" Jun 11 14:32:47.694144 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.694101 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:32:47.992314 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:47.992242 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/init-textfile/0.log" Jun 11 14:32:48.081142 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:48.081114 2566 scope.go:117] "RemoveContainer" containerID="8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66" Jun 11 14:32:48.081617 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:48.081293 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f58d8985c-ffskw_open-cluster-management-agent-addon(b3a72038-d82c-47c2-bf78-e12a14e5deb9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" podUID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" Jun 11 14:32:48.194550 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:48.194521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/node-exporter/0.log" Jun 11 14:32:48.392528 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:48.392499 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/kube-rbac-proxy/0.log" Jun 11 14:32:49.462753 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.462721 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" Jun 11 14:32:49.463145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.463036 2566 scope.go:117] "RemoveContainer" containerID="4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e" Jun 11 14:32:49.463208 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:49.463189 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-bc58844f4-vsrhz_open-cluster-management-agent-addon(3f8219be-2901-41c2-b2d1-c107d75ee390)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" podUID="3f8219be-2901-41c2-b2d1-c107d75ee390" Jun 11 14:32:49.471029 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.470999 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" podUID="2027d7e6-58c2-48f5-a226-9d4a028ee2f4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 14:32:49.471159 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.471055 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" Jun 11 14:32:49.471495 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.471463 2566 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d37254a076043cfc4400761bcfb6c01e5128ebbcc5a673cd5da2e584f0a245a3"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 14:32:49.471565 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.471519 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" podUID="2027d7e6-58c2-48f5-a226-9d4a028ee2f4" containerName="service-proxy" containerID="cri-o://d37254a076043cfc4400761bcfb6c01e5128ebbcc5a673cd5da2e584f0a245a3" gracePeriod=30 Jun 11 14:32:49.484353 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.484330 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:32:49.484662 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:49.484650 2566 scope.go:117] "RemoveContainer" containerID="8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66" Jun 11 14:32:49.484795 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:32:49.484780 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6f58d8985c-ffskw_open-cluster-management-agent-addon(b3a72038-d82c-47c2-bf78-e12a14e5deb9)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" podUID="b3a72038-d82c-47c2-bf78-e12a14e5deb9" Jun 11 14:32:50.090597 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:50.090560 2566 generic.go:356] "Generic (PLEG): container finished" podID="2027d7e6-58c2-48f5-a226-9d4a028ee2f4" containerID="d37254a076043cfc4400761bcfb6c01e5128ebbcc5a673cd5da2e584f0a245a3" exitCode=2 Jun 11 14:32:50.090756 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:50.090614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerDied","Data":"d37254a076043cfc4400761bcfb6c01e5128ebbcc5a673cd5da2e584f0a245a3"} Jun 11 14:32:50.090756 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:50.090653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d868d7dd6-t4zb2" event={"ID":"2027d7e6-58c2-48f5-a226-9d4a028ee2f4","Type":"ContainerStarted","Data":"538e65f770f14062ce55f2f72e478b0e5024ddb1ff12771e2220e5c844f15e5a"} Jun 11 14:32:51.021246 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:51.021210 2566 patch_prober.go:28] interesting pod/image-registry-5bfd46c4cc-ht8wj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:32:51.021594 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:51.021261 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:32:52.143412 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:52.143376 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:52.281885 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:52.281848 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:52.400538 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:52.400453 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:52.662991 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:52.662907 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:52.767823 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:52.767777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:53.028738 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:53.028710 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:32:53.473621 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:53.473536 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:53.566752 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:53.566719 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:54.612026 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:54.611992 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:54.712433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:54.712394 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:54.793749 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:54.793730 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2md4m_70e89735-b15c-4a29-a301-118c61643dd7/dns/0.log" Jun 11 14:32:54.994450 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:54.994377 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2md4m_70e89735-b15c-4a29-a301-118c61643dd7/kube-rbac-proxy/0.log" Jun 11 14:32:56.393058 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:56.393033 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qfmdc_6e9d9442-5174-40bf-99a0-c95249deef4f/dns-node-resolver/0.log" Jun 11 14:32:56.795325 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:56.795297 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bfd46c4cc-ht8wj_320d1e22-bf1a-4c0a-9be2-b094121557b5/registry/0.log" Jun 11 14:32:57.192875 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:57.192774 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzctx_c29cf67e-2170-471f-9fd2-0118b1a2c592/node-ca/0.log" Jun 11 14:32:57.794998 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:57.794973 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5z2bw_04f21d6a-eaea-445d-898a-b6e51b31a288/serve-healthcheck-canary/0.log" Jun 11 14:32:59.503517 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:59.503447 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:59.685448 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:59.685403 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:32:59.794399 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:32:59.794369 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:03.688168 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:03.688128 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:03.783246 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:03.783210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:04.080501 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:04.080472 2566 scope.go:117] "RemoveContainer" containerID="8f561cdf694d03aecbc7e1eab8d828221ff2b06f5ad537a8babc7618155a8f66" Jun 11 14:33:04.080667 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:04.080565 2566 scope.go:117] "RemoveContainer" containerID="4c75cdc81702860e7bf167a48be55a5cd4ffa514f220f914dd219ee31aa1186e" Jun 11 14:33:05.145565 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:05.145528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" event={"ID":"b3a72038-d82c-47c2-bf78-e12a14e5deb9","Type":"ContainerStarted","Data":"21e727e1346311ff1c4edd915e07adfc50024e6d8bf8aa3a99f9ff69f2c15829"} Jun 11 14:33:05.146013 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:05.145868 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:33:05.147417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:05.147396 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bc58844f4-vsrhz" event={"ID":"3f8219be-2901-41c2-b2d1-c107d75ee390","Type":"ContainerStarted","Data":"2ef72289ce8362d36064494bc5fb9a2353cbfc7c787e1df499b3dac8916df19b"} Jun 11 14:33:05.147665 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:05.147648 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f58d8985c-ffskw" Jun 11 14:33:06.760266 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:06.760231 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:06.874992 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:06.874956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:12.672074 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:12.672038 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:33:12.783201 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:12.783171 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:12.843271 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:12.843237 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:12.928793 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:12.928696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:12.995844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:12.995813 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:14.801820 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:14.801777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:15.409954 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:15.409925 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:16.320097 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:16.320065 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:16.378857 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:16.378794 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:21.753258 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:21.753218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:21.856853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:21.856794 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:24.697822 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:24.697767 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:24.753568 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:24.753538 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:24.852879 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:24.852849 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:24.949764 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:24.949676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:25.451907 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:25.451874 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:25.553119 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:25.553082 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:25.788638 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:25.788604 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:25.885161 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:25.885126 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:35.961318 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:35.961226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:36.019427 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:36.019379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:36.073739 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:36.073712 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:36.750758 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:36.750725 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:36.848523 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:36.848490 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:33:37.691497 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.691459 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerName="registry" containerID="cri-o://e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98" gracePeriod=30 Jun 11 14:33:37.927968 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.927947 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:33:37.988861 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988765 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.988861 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988795 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.988861 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988842 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988884 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988907 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988942 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.988970 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66jkb\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.989009 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets\") pod \"320d1e22-bf1a-4c0a-9be2-b094121557b5\" (UID: \"320d1e22-bf1a-4c0a-9be2-b094121557b5\") " Jun 11 14:33:37.989522 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.989453 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:37.989522 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.989450 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:37.991400 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.991358 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:33:37.991678 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.991649 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:37.991844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.991822 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:33:37.991922 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.991901 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb" (OuterVolumeSpecName: "kube-api-access-66jkb") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "kube-api-access-66jkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:33:37.991960 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.991909 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:37.998135 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:37.998111 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "320d1e22-bf1a-4c0a-9be2-b094121557b5" (UID: "320d1e22-bf1a-4c0a-9be2-b094121557b5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:33:38.089606 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089573 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/320d1e22-bf1a-4c0a-9be2-b094121557b5-ca-trust-extracted\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089606 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089600 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-trusted-ca\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089606 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089610 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-certificates\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089619 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66jkb\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-kube-api-access-66jkb\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089627 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-installation-pull-secrets\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089635 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-registry-tls\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089643 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/320d1e22-bf1a-4c0a-9be2-b094121557b5-bound-sa-token\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.089821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.089651 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/320d1e22-bf1a-4c0a-9be2-b094121557b5-image-registry-private-configuration\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:33:38.254969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.254874 2566 generic.go:356] "Generic (PLEG): container finished" podID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerID="e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98" exitCode=0 Jun 11 14:33:38.254969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.254911 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" event={"ID":"320d1e22-bf1a-4c0a-9be2-b094121557b5","Type":"ContainerDied","Data":"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98"} Jun 11 14:33:38.254969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.254921 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" Jun 11 14:33:38.254969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.254945 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfd46c4cc-ht8wj" event={"ID":"320d1e22-bf1a-4c0a-9be2-b094121557b5","Type":"ContainerDied","Data":"36476fc6059700d0891735a395666bd5166c3cba2652f0609438c344ad8fc31b"} Jun 11 14:33:38.254969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.254963 2566 scope.go:117] "RemoveContainer" containerID="e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98" Jun 11 14:33:38.262552 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.262534 2566 scope.go:117] "RemoveContainer" containerID="e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98" Jun 11 14:33:38.262776 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:33:38.262758 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98\": container with ID starting with e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98 not found: ID does not exist" containerID="e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98" Jun 11 14:33:38.262859 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.262783 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98"} err="failed to get container status \"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98\": rpc error: code = NotFound desc = could not find container \"e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98\": container with ID starting with e5e0a6dc6e7691eb58ba58a435149f6b602d1bb09a17b58e4313986ef501ed98 not found: ID does not exist" Jun 11 14:33:38.270646 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.270625 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:33:38.275064 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:38.275043 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bfd46c4cc-ht8wj"] Jun 11 14:33:40.085486 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:33:40.085455 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" path="/var/lib/kubelet/pods/320d1e22-bf1a-4c0a-9be2-b094121557b5/volumes" Jun 11 14:34:13.409210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:13.409172 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:13.509133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:13.509097 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:30.056108 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:30.056062 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:30.115993 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:30.115960 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:41.986732 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:41.986686 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:42.042166 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:42.042137 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:51.438710 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:51.438676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:51.492564 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:51.492531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:51.828032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:51.827981 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:51.953995 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:51.953954 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:34:52.138225 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:34:52.138141 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:02.369691 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:02.369599 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:02.471689 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:02.471649 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:02.557758 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:02.557725 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:15.140270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.140226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:15.234245 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.234210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:15.871710 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.871674 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7"] Jun 11 14:35:15.872052 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.872035 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerName="registry" Jun 11 14:35:15.872104 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.872055 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerName="registry" Jun 11 14:35:15.872138 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.872109 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="320d1e22-bf1a-4c0a-9be2-b094121557b5" containerName="registry" Jun 11 14:35:15.874956 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.874942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:15.877894 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.877875 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:35:15.878786 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.878769 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:35:15.881880 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.881860 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:35:15.893322 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.893301 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7"] Jun 11 14:35:15.938666 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.938635 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb542\" (UniqueName: \"kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:15.938872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.938679 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:15.938872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:15.938729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.039657 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.039625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.039789 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.039675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb542\" (UniqueName: \"kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.039789 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.039704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.040002 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.039984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.040066 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.040047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.048726 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.048699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb542\" (UniqueName: \"kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.183464 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.183388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:16.310757 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.310724 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7"] Jun 11 14:35:16.313601 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:35:16.313571 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7260194a_0ede_4b3c_a4e6_e1f6361aa0cc.slice/crio-b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391 WatchSource:0}: Error finding container b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391: Status 404 returned error can't find the container with id b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391 Jun 11 14:35:16.315412 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.315393 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:35:16.571625 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:16.571587 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" event={"ID":"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc","Type":"ContainerStarted","Data":"b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391"} Jun 11 14:35:23.598119 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:23.598029 2566 generic.go:356] "Generic (PLEG): container finished" podID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerID="b631bc3cfe436bf88d607a7e4c6177782e73f8528051bcd3036fa7ee71807d22" exitCode=0 Jun 11 14:35:23.598119 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:23.598083 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" event={"ID":"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc","Type":"ContainerDied","Data":"b631bc3cfe436bf88d607a7e4c6177782e73f8528051bcd3036fa7ee71807d22"} Jun 11 14:35:25.606052 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:25.606019 2566 generic.go:356] "Generic (PLEG): container finished" podID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerID="c10cbe9a463b107fb1cd93926b37713f657d2e22fe18514ed5ca6e7a9ae9790d" exitCode=0 Jun 11 14:35:25.606432 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:25.606063 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" event={"ID":"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc","Type":"ContainerDied","Data":"c10cbe9a463b107fb1cd93926b37713f657d2e22fe18514ed5ca6e7a9ae9790d"} Jun 11 14:35:33.639712 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:33.639674 2566 generic.go:356] "Generic (PLEG): container finished" podID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerID="001a75abf61e11f59b341bb413e619a925fdb2103d1f2581cc9b486ca8571890" exitCode=0 Jun 11 14:35:33.640198 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:33.639746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" event={"ID":"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc","Type":"ContainerDied","Data":"001a75abf61e11f59b341bb413e619a925fdb2103d1f2581cc9b486ca8571890"} Jun 11 14:35:34.767673 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.767641 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:34.883439 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.883408 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util\") pod \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " Jun 11 14:35:34.883589 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.883455 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle\") pod \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " Jun 11 14:35:34.883589 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.883493 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb542\" (UniqueName: \"kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542\") pod \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\" (UID: \"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc\") " Jun 11 14:35:34.884198 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.884151 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle" (OuterVolumeSpecName: "bundle") pod "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" (UID: "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:35:34.885764 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.885740 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542" (OuterVolumeSpecName: "kube-api-access-kb542") pod "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" (UID: "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc"). InnerVolumeSpecName "kube-api-access-kb542". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:35:34.887374 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.887354 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util" (OuterVolumeSpecName: "util") pod "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" (UID: "7260194a-0ede-4b3c-a4e6-e1f6361aa0cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:35:34.984061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.984004 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:34.984061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.984024 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:34.984061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:34.984033 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb542\" (UniqueName: \"kubernetes.io/projected/7260194a-0ede-4b3c-a4e6-e1f6361aa0cc-kube-api-access-kb542\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:35.647975 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:35.647941 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" event={"ID":"7260194a-0ede-4b3c-a4e6-e1f6361aa0cc","Type":"ContainerDied","Data":"b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391"} Jun 11 14:35:35.648168 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:35.647994 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9546d66455f5b9d4035d858940470214c7f0c5cb6d4a90fcb8c34e7bfc4a391" Jun 11 14:35:35.648168 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:35.647958 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5fsw7" Jun 11 14:35:42.451097 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:42.451068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:44.703932 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:44.703893 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:46.473373 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:46.473337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:46.576612 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:46.576576 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:48.779923 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:48.779887 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:48.891150 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:48.891118 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:48.993733 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:48.993697 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:49.544837 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.544784 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds"] Jun 11 14:35:49.545125 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545108 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="util" Jun 11 14:35:49.545210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545127 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="util" Jun 11 14:35:49.545210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545138 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="pull" Jun 11 14:35:49.545210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545145 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="pull" Jun 11 14:35:49.545210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545157 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="extract" Jun 11 14:35:49.545210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545166 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="extract" Jun 11 14:35:49.545456 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.545238 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7260194a-0ede-4b3c-a4e6-e1f6361aa0cc" containerName="extract" Jun 11 14:35:49.547575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.547554 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.549974 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.549943 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:35:49.550092 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.550060 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:35:49.551018 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.550999 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:35:49.552309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.552287 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds"] Jun 11 14:35:49.683707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.683670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.683707 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.683706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.683941 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.683763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt7xr\" (UniqueName: \"kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.784977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.784945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt7xr\" (UniqueName: \"kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.785346 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.784999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.785346 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.785019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.785465 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.785445 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.785501 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.785463 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.794689 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.794665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt7xr\" (UniqueName: \"kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.857570 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.857495 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:49.985199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:49.985113 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds"] Jun 11 14:35:49.989150 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:35:49.989122 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a5998f_fdcc_449c_8e53_051b199badf3.slice/crio-241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7 WatchSource:0}: Error finding container 241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7: Status 404 returned error can't find the container with id 241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7 Jun 11 14:35:50.696376 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:50.696338 2566 generic.go:356] "Generic (PLEG): container finished" podID="04a5998f-fdcc-449c-8e53-051b199badf3" containerID="e002e24a40926041918bbce8429530cbf4f2848b278ee9bc268f0b0c470de5ce" exitCode=0 Jun 11 14:35:50.696558 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:50.696384 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" event={"ID":"04a5998f-fdcc-449c-8e53-051b199badf3","Type":"ContainerDied","Data":"e002e24a40926041918bbce8429530cbf4f2848b278ee9bc268f0b0c470de5ce"} Jun 11 14:35:50.696558 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:50.696417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" event={"ID":"04a5998f-fdcc-449c-8e53-051b199badf3","Type":"ContainerStarted","Data":"241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7"} Jun 11 14:35:52.467955 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:52.467918 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:52.733132 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:52.733039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:53.653177 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:53.653145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:53.708377 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:53.708348 2566 generic.go:356] "Generic (PLEG): container finished" podID="04a5998f-fdcc-449c-8e53-051b199badf3" containerID="f89a82dcadc8fcb08859590dcf70e1e7180e8f10f56bbcd3d3ea62e04f5634dd" exitCode=0 Jun 11 14:35:53.708502 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:53.708399 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" event={"ID":"04a5998f-fdcc-449c-8e53-051b199badf3","Type":"ContainerDied","Data":"f89a82dcadc8fcb08859590dcf70e1e7180e8f10f56bbcd3d3ea62e04f5634dd"} Jun 11 14:35:53.715376 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:53.715350 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:54.713896 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:54.713864 2566 generic.go:356] "Generic (PLEG): container finished" podID="04a5998f-fdcc-449c-8e53-051b199badf3" containerID="eeb70865493738fcd77f500655b8f05bd88078577dfcdb526f82b31188db1158" exitCode=0 Jun 11 14:35:54.714260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:54.713916 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" event={"ID":"04a5998f-fdcc-449c-8e53-051b199badf3","Type":"ContainerDied","Data":"eeb70865493738fcd77f500655b8f05bd88078577dfcdb526f82b31188db1158"} Jun 11 14:35:55.835992 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.835968 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:55.929952 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.929920 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util\") pod \"04a5998f-fdcc-449c-8e53-051b199badf3\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " Jun 11 14:35:55.930139 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.929972 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle\") pod \"04a5998f-fdcc-449c-8e53-051b199badf3\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " Jun 11 14:35:55.930139 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.929999 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt7xr\" (UniqueName: \"kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr\") pod \"04a5998f-fdcc-449c-8e53-051b199badf3\" (UID: \"04a5998f-fdcc-449c-8e53-051b199badf3\") " Jun 11 14:35:55.930343 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.930319 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle" (OuterVolumeSpecName: "bundle") pod "04a5998f-fdcc-449c-8e53-051b199badf3" (UID: "04a5998f-fdcc-449c-8e53-051b199badf3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:35:55.932219 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.932195 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr" (OuterVolumeSpecName: "kube-api-access-jt7xr") pod "04a5998f-fdcc-449c-8e53-051b199badf3" (UID: "04a5998f-fdcc-449c-8e53-051b199badf3"). InnerVolumeSpecName "kube-api-access-jt7xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:35:55.934591 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:55.934567 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util" (OuterVolumeSpecName: "util") pod "04a5998f-fdcc-449c-8e53-051b199badf3" (UID: "04a5998f-fdcc-449c-8e53-051b199badf3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:35:56.030659 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.030632 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:56.030659 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.030658 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04a5998f-fdcc-449c-8e53-051b199badf3-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:56.030843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.030667 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt7xr\" (UniqueName: \"kubernetes.io/projected/04a5998f-fdcc-449c-8e53-051b199badf3-kube-api-access-jt7xr\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:35:56.722847 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.722790 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" event={"ID":"04a5998f-fdcc-449c-8e53-051b199badf3","Type":"ContainerDied","Data":"241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7"} Jun 11 14:35:56.722847 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.722845 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5t6ds" Jun 11 14:35:56.723045 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.722862 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="241115151cf9cc0bc9ca746f7ecd3f10a92433a69b0264f974afeec0af55f5b7" Jun 11 14:35:56.941160 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:56.941125 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:57.040202 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:57.040169 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:59.500701 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500673 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-krqnl"] Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500919 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="pull" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500930 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="pull" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500946 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="util" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500952 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="util" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500959 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="extract" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.500965 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="extract" Jun 11 14:35:59.501110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.501007 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a5998f-fdcc-449c-8e53-051b199badf3" containerName="extract" Jun 11 14:35:59.504732 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.504716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.507158 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.507137 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:35:59.507158 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.507150 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:35:59.508015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.508002 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gxkfv\"" Jun 11 14:35:59.511697 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.511677 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-krqnl"] Jun 11 14:35:59.515182 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.515145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:35:59.654618 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.654583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-bound-sa-token\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.654760 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.654632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlk7b\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-kube-api-access-wlk7b\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.755340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.755265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-bound-sa-token\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.755340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.755309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlk7b\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-kube-api-access-wlk7b\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.763703 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.763679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-bound-sa-token\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.763891 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.763872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlk7b\" (UniqueName: \"kubernetes.io/projected/b12afa72-1fa1-4b91-b13a-527c735b1f50-kube-api-access-wlk7b\") pod \"cert-manager-59c77684cc-krqnl\" (UID: \"b12afa72-1fa1-4b91-b13a-527c735b1f50\") " pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.813740 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.813712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-krqnl" Jun 11 14:35:59.938400 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:35:59.938366 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-krqnl"] Jun 11 14:35:59.941563 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:35:59.941539 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb12afa72_1fa1_4b91_b13a_527c735b1f50.slice/crio-4e9bf68d8424bcd62f94cfeebd7f3a96c5a08dac65f1f4866827bfbad030676f WatchSource:0}: Error finding container 4e9bf68d8424bcd62f94cfeebd7f3a96c5a08dac65f1f4866827bfbad030676f: Status 404 returned error can't find the container with id 4e9bf68d8424bcd62f94cfeebd7f3a96c5a08dac65f1f4866827bfbad030676f Jun 11 14:36:00.451875 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:00.451838 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:00.552357 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:00.552322 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:00.737667 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:00.737578 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-krqnl" event={"ID":"b12afa72-1fa1-4b91-b13a-527c735b1f50","Type":"ContainerStarted","Data":"4e9bf68d8424bcd62f94cfeebd7f3a96c5a08dac65f1f4866827bfbad030676f"} Jun 11 14:36:03.749661 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:03.749624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-krqnl" event={"ID":"b12afa72-1fa1-4b91-b13a-527c735b1f50","Type":"ContainerStarted","Data":"c5d25d3eb674354ed29fa8152839fd0bdd129b4be14d980f5a1ff0d8ecdf0c5c"} Jun 11 14:36:03.767151 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:03.767095 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-krqnl" podStartSLOduration=1.554453885 podStartE2EDuration="4.76707655s" totalImagesPullingTime="3.212622665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:03.76636177 +0000 UTC m=+498.192354437" watchObservedRunningTime="2026-06-11 14:36:03.76707655 +0000 UTC m=+498.193069227" Jun 11 14:36:07.680725 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:07.680688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:07.770110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:07.770068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:09.736888 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.736849 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v"] Jun 11 14:36:09.740336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.740313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.743099 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.743077 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:36:09.743204 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.743122 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:36:09.744071 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.744054 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:36:09.750037 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.750017 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v"] Jun 11 14:36:09.832383 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.832347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.832551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.832402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjbs\" (UniqueName: \"kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.832551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.832468 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.861416 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.861387 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:09.932891 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.932868 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.932996 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.932920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.932996 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.932959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjbs\" (UniqueName: \"kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.933308 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.933291 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.933345 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.933317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:09.942464 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:09.942438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjbs\" (UniqueName: \"kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:10.049511 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.049486 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:10.180788 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.180757 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v"] Jun 11 14:36:10.183953 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:10.183924 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1834c9b1_5f46_41c0_bb3b_081236a00d54.slice/crio-3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40 WatchSource:0}: Error finding container 3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40: Status 404 returned error can't find the container with id 3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40 Jun 11 14:36:10.370040 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.369956 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:10.428561 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.428531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:10.773952 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.773921 2566 generic.go:356] "Generic (PLEG): container finished" podID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerID="bd65ad67261280b82d97cd803afdf518ada7ef88586a9510f8bc70e98dc7cf6a" exitCode=0 Jun 11 14:36:10.774336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.773996 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" event={"ID":"1834c9b1-5f46-41c0-bb3b-081236a00d54","Type":"ContainerDied","Data":"bd65ad67261280b82d97cd803afdf518ada7ef88586a9510f8bc70e98dc7cf6a"} Jun 11 14:36:10.774336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:10.774031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" event={"ID":"1834c9b1-5f46-41c0-bb3b-081236a00d54","Type":"ContainerStarted","Data":"3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40"} Jun 11 14:36:11.778719 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:11.778690 2566 generic.go:356] "Generic (PLEG): container finished" podID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerID="49705520ce7895c5f6a7659cb12980916287fd72a3394bdc8d1cb750b1420d2d" exitCode=0 Jun 11 14:36:11.779112 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:11.778775 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" event={"ID":"1834c9b1-5f46-41c0-bb3b-081236a00d54","Type":"ContainerDied","Data":"49705520ce7895c5f6a7659cb12980916287fd72a3394bdc8d1cb750b1420d2d"} Jun 11 14:36:12.788548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:12.788513 2566 generic.go:356] "Generic (PLEG): container finished" podID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerID="e08dfd9013c0073c36641ac623a43a4d0a70ae1ae061b231fcda401bc25bf396" exitCode=0 Jun 11 14:36:12.788934 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:12.788585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" event={"ID":"1834c9b1-5f46-41c0-bb3b-081236a00d54","Type":"ContainerDied","Data":"e08dfd9013c0073c36641ac623a43a4d0a70ae1ae061b231fcda401bc25bf396"} Jun 11 14:36:13.911260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:13.911235 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:14.063336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.063246 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util\") pod \"1834c9b1-5f46-41c0-bb3b-081236a00d54\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " Jun 11 14:36:14.063336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.063301 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbjbs\" (UniqueName: \"kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs\") pod \"1834c9b1-5f46-41c0-bb3b-081236a00d54\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " Jun 11 14:36:14.063336 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.063334 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle\") pod \"1834c9b1-5f46-41c0-bb3b-081236a00d54\" (UID: \"1834c9b1-5f46-41c0-bb3b-081236a00d54\") " Jun 11 14:36:14.064125 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.064102 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle" (OuterVolumeSpecName: "bundle") pod "1834c9b1-5f46-41c0-bb3b-081236a00d54" (UID: "1834c9b1-5f46-41c0-bb3b-081236a00d54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:36:14.065503 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.065484 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs" (OuterVolumeSpecName: "kube-api-access-kbjbs") pod "1834c9b1-5f46-41c0-bb3b-081236a00d54" (UID: "1834c9b1-5f46-41c0-bb3b-081236a00d54"). InnerVolumeSpecName "kube-api-access-kbjbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:36:14.071442 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.071418 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util" (OuterVolumeSpecName: "util") pod "1834c9b1-5f46-41c0-bb3b-081236a00d54" (UID: "1834c9b1-5f46-41c0-bb3b-081236a00d54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:36:14.164455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.164430 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:14.164455 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.164452 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbjbs\" (UniqueName: \"kubernetes.io/projected/1834c9b1-5f46-41c0-bb3b-081236a00d54-kube-api-access-kbjbs\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:14.164605 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.164464 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1834c9b1-5f46-41c0-bb3b-081236a00d54-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:14.797226 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.797194 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" Jun 11 14:36:14.797226 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.797201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd79p8v" event={"ID":"1834c9b1-5f46-41c0-bb3b-081236a00d54","Type":"ContainerDied","Data":"3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40"} Jun 11 14:36:14.797428 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:14.797252 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c8e3175fc0749ce57838ac9bd4ba6eca34a0a395b4b27417f12d6040b079b40" Jun 11 14:36:18.019468 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:18.019428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:24.874423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:24.874382 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:24.972956 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:24.972926 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:25.476908 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.476873 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:25.787583 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.787556 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:25.896860 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.896830 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:25.924553 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924527 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr"] Jun 11 14:36:25.924771 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924760 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="extract" Jun 11 14:36:25.924843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924773 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="extract" Jun 11 14:36:25.924843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924789 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="util" Jun 11 14:36:25.924843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924795 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="util" Jun 11 14:36:25.924843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924815 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="pull" Jun 11 14:36:25.924843 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924821 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="pull" Jun 11 14:36:25.924995 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.924858 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1834c9b1-5f46-41c0-bb3b-081236a00d54" containerName="extract" Jun 11 14:36:25.931920 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.931904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.934932 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.934915 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-24gwh\"" Jun 11 14:36:25.935099 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.935082 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:36:25.935249 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.935222 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:36:25.935328 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.935231 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:36:25.935584 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.935565 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:36:25.947025 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.946994 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.947115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.947033 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.947115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.947052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.947115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.947079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6k6\" (UniqueName: \"kubernetes.io/projected/e03d1f39-b8db-48b0-9733-291d91e9e46f-kube-api-access-rv6k6\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.947115 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.947106 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:25.955922 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:25.955901 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr"] Jun 11 14:36:26.048040 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.047956 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.048040 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.048001 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.048040 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.048024 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.048636 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.048053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.048636 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.048083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6k6\" (UniqueName: \"kubernetes.io/projected/e03d1f39-b8db-48b0-9733-291d91e9e46f-kube-api-access-rv6k6\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.048636 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.048449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.050500 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.050472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e03d1f39-b8db-48b0-9733-291d91e9e46f-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.050695 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.050677 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.050782 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.050764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e03d1f39-b8db-48b0-9733-291d91e9e46f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.061047 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.061022 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6k6\" (UniqueName: \"kubernetes.io/projected/e03d1f39-b8db-48b0-9733-291d91e9e46f-kube-api-access-rv6k6\") pod \"opendatahub-operator-controller-manager-7cbcf64465-z6kpr\" (UID: \"e03d1f39-b8db-48b0-9733-291d91e9e46f\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.085499 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.085469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.186990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.186962 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.241422 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.241390 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:26.291080 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.290879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.392411 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.392379 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.422475 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.422445 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr"] Jun 11 14:36:26.429478 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:26.429452 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode03d1f39_b8db_48b0_9733_291d91e9e46f.slice/crio-cdb58402c0421cf39a4545b42c5f715e2905523a9009b27bebe964b388492f63 WatchSource:0}: Error finding container cdb58402c0421cf39a4545b42c5f715e2905523a9009b27bebe964b388492f63: Status 404 returned error can't find the container with id cdb58402c0421cf39a4545b42c5f715e2905523a9009b27bebe964b388492f63 Jun 11 14:36:26.505873 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.505825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.606387 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.606307 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.705781 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.705752 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.806012 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.805979 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:26.840868 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:26.840842 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" event={"ID":"e03d1f39-b8db-48b0-9733-291d91e9e46f","Type":"ContainerStarted","Data":"cdb58402c0421cf39a4545b42c5f715e2905523a9009b27bebe964b388492f63"} Jun 11 14:36:30.100617 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:30.100571 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:30.204987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:30.204941 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:30.863673 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:30.863638 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" event={"ID":"e03d1f39-b8db-48b0-9733-291d91e9e46f","Type":"ContainerStarted","Data":"356f4e64ef9523b3db717b5f69603dca95169a9117357dfc19efe91d2df1972e"} Jun 11 14:36:31.869130 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:31.869081 2566 generic.go:356] "Generic (PLEG): container finished" podID="e03d1f39-b8db-48b0-9733-291d91e9e46f" containerID="356f4e64ef9523b3db717b5f69603dca95169a9117357dfc19efe91d2df1972e" exitCode=0 Jun 11 14:36:31.869533 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:31.869140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" event={"ID":"e03d1f39-b8db-48b0-9733-291d91e9e46f","Type":"ContainerDied","Data":"356f4e64ef9523b3db717b5f69603dca95169a9117357dfc19efe91d2df1972e"} Jun 11 14:36:32.875213 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:32.875176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" event={"ID":"e03d1f39-b8db-48b0-9733-291d91e9e46f","Type":"ContainerStarted","Data":"44033769972e53c4407278e6a851c4fb33e43d16aa4516eddc2b544709a003e1"} Jun 11 14:36:32.875588 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:32.875301 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:32.911983 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:32.911929 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" podStartSLOduration=2.982151847 podStartE2EDuration="7.911912009s" totalImagesPullingTime="3.943461095s" totalInitContainerRuntime="986.299067ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:32.910859903 +0000 UTC m=+527.336852576" watchObservedRunningTime="2026-06-11 14:36:32.911912009 +0000 UTC m=+527.337904685" Jun 11 14:36:43.882359 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:43.882326 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-z6kpr" Jun 11 14:36:45.762859 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:45.762793 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:46.405468 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.405439 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn"] Jun 11 14:36:46.413739 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.413719 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.417914 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.417895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 14:36:46.418040 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.418019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 14:36:46.418092 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.418042 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:36:46.418325 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.418307 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gx9bs\"" Jun 11 14:36:46.418906 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.418866 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:36:46.424045 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.424026 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn"] Jun 11 14:36:46.489863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.489825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a7d403-924c-496a-95a5-cde6be12cd22-tmp\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.489863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.489862 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrng\" (UniqueName: \"kubernetes.io/projected/35a7d403-924c-496a-95a5-cde6be12cd22-kube-api-access-ftrng\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.490066 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.489986 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.590866 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.590838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.590866 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.590867 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a7d403-924c-496a-95a5-cde6be12cd22-tmp\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.591033 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.590888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrng\" (UniqueName: \"kubernetes.io/projected/35a7d403-924c-496a-95a5-cde6be12cd22-kube-api-access-ftrng\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.591033 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:46.590976 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 14:36:46.591103 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:46.591053 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs podName:35a7d403-924c-496a-95a5-cde6be12cd22 nodeName:}" failed. No retries permitted until 2026-06-11 14:36:47.091036972 +0000 UTC m=+541.517029626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs") pod "kube-auth-proxy-65cd6686fb-wvrrn" (UID: "35a7d403-924c-496a-95a5-cde6be12cd22") : secret "kube-auth-proxy-tls" not found Jun 11 14:36:46.593182 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.593162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35a7d403-924c-496a-95a5-cde6be12cd22-tmp\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:46.629094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:46.629068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrng\" (UniqueName: \"kubernetes.io/projected/35a7d403-924c-496a-95a5-cde6be12cd22-kube-api-access-ftrng\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:47.094288 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.094253 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:47.097268 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.097244 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35a7d403-924c-496a-95a5-cde6be12cd22-tls-certs\") pod \"kube-auth-proxy-65cd6686fb-wvrrn\" (UID: \"35a7d403-924c-496a-95a5-cde6be12cd22\") " pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:47.322701 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.322670 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" Jun 11 14:36:47.444608 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.444574 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:47.464193 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.464152 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn"] Jun 11 14:36:47.467940 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:47.467910 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a7d403_924c_496a_95a5_cde6be12cd22.slice/crio-4730a1c4f0a62472356bc5b2f2b30aa0636ccbd91601d8c37351e1538bf0aaea WatchSource:0}: Error finding container 4730a1c4f0a62472356bc5b2f2b30aa0636ccbd91601d8c37351e1538bf0aaea: Status 404 returned error can't find the container with id 4730a1c4f0a62472356bc5b2f2b30aa0636ccbd91601d8c37351e1538bf0aaea Jun 11 14:36:47.500780 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.500753 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x2f2t"] Jun 11 14:36:47.504999 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.504980 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.507464 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.507439 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 14:36:47.507919 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.507900 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-vcng7\"" Jun 11 14:36:47.518190 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.518171 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x2f2t"] Jun 11 14:36:47.558700 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.558676 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:47.598745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.598724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.598885 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.598827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rbs\" (UniqueName: \"kubernetes.io/projected/b00eaaad-2f53-4ea7-9bdc-57de805190ae-kube-api-access-n8rbs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.699587 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.699513 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rbs\" (UniqueName: \"kubernetes.io/projected/b00eaaad-2f53-4ea7-9bdc-57de805190ae-kube-api-access-n8rbs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.699587 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.699546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.699758 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:47.699653 2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 14:36:47.699758 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:47.699705 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs podName:b00eaaad-2f53-4ea7-9bdc-57de805190ae nodeName:}" failed. No retries permitted until 2026-06-11 14:36:48.199689401 +0000 UTC m=+542.625682055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs") pod "model-serving-api-5dd488fc48-x2f2t" (UID: "b00eaaad-2f53-4ea7-9bdc-57de805190ae") : secret "model-serving-api-tls" not found Jun 11 14:36:47.708016 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.707993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rbs\" (UniqueName: \"kubernetes.io/projected/b00eaaad-2f53-4ea7-9bdc-57de805190ae-kube-api-access-n8rbs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:47.931062 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:47.931023 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" event={"ID":"35a7d403-924c-496a-95a5-cde6be12cd22","Type":"ContainerStarted","Data":"4730a1c4f0a62472356bc5b2f2b30aa0636ccbd91601d8c37351e1538bf0aaea"} Jun 11 14:36:48.204527 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:48.204485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:48.204996 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:48.204653 2566 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 14:36:48.204996 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:36:48.204741 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs podName:b00eaaad-2f53-4ea7-9bdc-57de805190ae nodeName:}" failed. No retries permitted until 2026-06-11 14:36:49.204718572 +0000 UTC m=+543.630711232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs") pod "model-serving-api-5dd488fc48-x2f2t" (UID: "b00eaaad-2f53-4ea7-9bdc-57de805190ae") : secret "model-serving-api-tls" not found Jun 11 14:36:48.370361 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:48.370321 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:49.213913 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.213877 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:49.216743 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.216687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b00eaaad-2f53-4ea7-9bdc-57de805190ae-tls-certs\") pod \"model-serving-api-5dd488fc48-x2f2t\" (UID: \"b00eaaad-2f53-4ea7-9bdc-57de805190ae\") " pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:49.314969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.314933 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:49.399869 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.399834 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj"] Jun 11 14:36:49.404002 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.403899 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.406793 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.406655 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:36:49.406793 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.406701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:36:49.408647 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.408570 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:36:49.412770 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.412704 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj"] Jun 11 14:36:49.489076 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.489005 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x2f2t"] Jun 11 14:36:49.491790 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:49.491762 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00eaaad_2f53_4ea7_9bdc_57de805190ae.slice/crio-e711d31406eb9168efb796a398b0320c12f72d5b542078394bfd257529d13782 WatchSource:0}: Error finding container e711d31406eb9168efb796a398b0320c12f72d5b542078394bfd257529d13782: Status 404 returned error can't find the container with id e711d31406eb9168efb796a398b0320c12f72d5b542078394bfd257529d13782 Jun 11 14:36:49.515768 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.515746 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqknl\" (UniqueName: \"kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.515891 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.515865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.515945 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.515892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.616852 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.616784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.617010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.616863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.617010 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.616911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqknl\" (UniqueName: \"kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.617247 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.617217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.617247 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.617235 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.626025 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.626003 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqknl\" (UniqueName: \"kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.722180 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.722150 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:49.846120 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.846091 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj"] Jun 11 14:36:49.849038 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:49.849016 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692a9e16_fd8e_4cab_8354_798f8b1f56ee.slice/crio-f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc WatchSource:0}: Error finding container f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc: Status 404 returned error can't find the container with id f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc Jun 11 14:36:49.942186 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.942149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" event={"ID":"b00eaaad-2f53-4ea7-9bdc-57de805190ae","Type":"ContainerStarted","Data":"e711d31406eb9168efb796a398b0320c12f72d5b542078394bfd257529d13782"} Jun 11 14:36:49.943680 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.943653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerStarted","Data":"39f1783c72d1f52c721521dc1286fa926492192242bbde4a6798393007c11dd0"} Jun 11 14:36:49.943794 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:49.943694 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerStarted","Data":"f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc"} Jun 11 14:36:50.950125 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:50.950081 2566 generic.go:356] "Generic (PLEG): container finished" podID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerID="39f1783c72d1f52c721521dc1286fa926492192242bbde4a6798393007c11dd0" exitCode=0 Jun 11 14:36:50.950539 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:50.950168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerDied","Data":"39f1783c72d1f52c721521dc1286fa926492192242bbde4a6798393007c11dd0"} Jun 11 14:36:52.959939 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.959902 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" event={"ID":"b00eaaad-2f53-4ea7-9bdc-57de805190ae","Type":"ContainerStarted","Data":"2e0c971828653790ee8589b974219e1934c2b383c58fcec0c9f014ed5cc8c639"} Jun 11 14:36:52.960373 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.960056 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:36:52.963834 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.962367 2566 generic.go:356] "Generic (PLEG): container finished" podID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerID="5628a08945484c7563480663cf92ef0e7499995b52edcc0c6636e44ee422c101" exitCode=0 Jun 11 14:36:52.963834 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.962503 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerDied","Data":"5628a08945484c7563480663cf92ef0e7499995b52edcc0c6636e44ee422c101"} Jun 11 14:36:52.964445 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.964415 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" event={"ID":"35a7d403-924c-496a-95a5-cde6be12cd22","Type":"ContainerStarted","Data":"13c990d60df83afa2fdae714af4ac965c79e10dea5a77cc7287b2c3c8a559406"} Jun 11 14:36:52.975487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:52.975441 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" podStartSLOduration=3.569378646 podStartE2EDuration="5.975424595s" totalImagesPullingTime="2.406045949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:52.974591905 +0000 UTC m=+547.400584583" watchObservedRunningTime="2026-06-11 14:36:52.975424595 +0000 UTC m=+547.401417271" Jun 11 14:36:53.004863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:53.004791 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65cd6686fb-wvrrn" podStartSLOduration=2.564774183 podStartE2EDuration="7.004778054s" totalImagesPullingTime="4.440003871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:53.003190981 +0000 UTC m=+547.429183656" watchObservedRunningTime="2026-06-11 14:36:53.004778054 +0000 UTC m=+547.430770730" Jun 11 14:36:53.970277 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:53.970242 2566 generic.go:356] "Generic (PLEG): container finished" podID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerID="579efec3a4f5adeee3da22b53b4493d51f2a67485ce196fa4ddbbca9df9548a6" exitCode=0 Jun 11 14:36:53.970677 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:53.970327 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerDied","Data":"579efec3a4f5adeee3da22b53b4493d51f2a67485ce196fa4ddbbca9df9548a6"} Jun 11 14:36:55.098002 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.097979 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:55.161870 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.161828 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle\") pod \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " Jun 11 14:36:55.161870 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.161887 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util\") pod \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " Jun 11 14:36:55.162122 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.161937 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqknl\" (UniqueName: \"kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl\") pod \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\" (UID: \"692a9e16-fd8e-4cab-8354-798f8b1f56ee\") " Jun 11 14:36:55.162764 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.162737 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle" (OuterVolumeSpecName: "bundle") pod "692a9e16-fd8e-4cab-8354-798f8b1f56ee" (UID: "692a9e16-fd8e-4cab-8354-798f8b1f56ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:36:55.164160 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.164130 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl" (OuterVolumeSpecName: "kube-api-access-tqknl") pod "692a9e16-fd8e-4cab-8354-798f8b1f56ee" (UID: "692a9e16-fd8e-4cab-8354-798f8b1f56ee"). InnerVolumeSpecName "kube-api-access-tqknl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:36:55.166877 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.166854 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util" (OuterVolumeSpecName: "util") pod "692a9e16-fd8e-4cab-8354-798f8b1f56ee" (UID: "692a9e16-fd8e-4cab-8354-798f8b1f56ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:36:55.263300 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.263278 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:55.263300 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.263303 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqknl\" (UniqueName: \"kubernetes.io/projected/692a9e16-fd8e-4cab-8354-798f8b1f56ee-kube-api-access-tqknl\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:55.263477 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.263312 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/692a9e16-fd8e-4cab-8354-798f8b1f56ee-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:36:55.980549 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.980518 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" event={"ID":"692a9e16-fd8e-4cab-8354-798f8b1f56ee","Type":"ContainerDied","Data":"f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc"} Jun 11 14:36:55.980708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.980561 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f37538142c9de01ff167176e269ec3504c4d9750f02f51e2af5604bd213e8ddc" Jun 11 14:36:55.980708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:55.980561 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06rxpsj" Jun 11 14:36:58.497253 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.497225 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:58.743260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.743216 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:58.782716 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.782689 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj"] Jun 11 14:36:58.782986 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.782974 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="pull" Jun 11 14:36:58.783032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.782988 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="pull" Jun 11 14:36:58.783032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.783003 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="extract" Jun 11 14:36:58.783032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.783008 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="extract" Jun 11 14:36:58.783032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.783020 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="util" Jun 11 14:36:58.783032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.783025 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="util" Jun 11 14:36:58.783172 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.783066 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="692a9e16-fd8e-4cab-8354-798f8b1f56ee" containerName="extract" Jun 11 14:36:58.786111 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.786095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:58.795702 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.795686 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 14:36:58.802630 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.802611 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9k4q8"] Jun 11 14:36:58.805563 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.805549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.808763 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.808742 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qf6rj\"" Jun 11 14:36:58.808872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.808780 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jzrwn\"" Jun 11 14:36:58.810563 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.810540 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 14:36:58.870846 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.870796 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9k4q8"] Jun 11 14:36:58.874383 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.874357 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj"] Jun 11 14:36:58.895572 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.895541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05694f94-1d92-4b68-bb8f-84445636f3cf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:58.895709 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.895584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-cert\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.895709 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.895653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxdz\" (UniqueName: \"kubernetes.io/projected/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-kube-api-access-spxdz\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.895709 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.895691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrpvd\" (UniqueName: \"kubernetes.io/projected/05694f94-1d92-4b68-bb8f-84445636f3cf-kube-api-access-vrpvd\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:58.908297 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.908271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:58.989670 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.989635 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:36:58.997009 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.996983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-cert\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.997169 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.997034 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxdz\" (UniqueName: \"kubernetes.io/projected/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-kube-api-access-spxdz\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.997169 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.997054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrpvd\" (UniqueName: \"kubernetes.io/projected/05694f94-1d92-4b68-bb8f-84445636f3cf-kube-api-access-vrpvd\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:58.997169 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.997086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05694f94-1d92-4b68-bb8f-84445636f3cf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:58.999697 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.999666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-cert\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:58.999697 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:58.999695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05694f94-1d92-4b68-bb8f-84445636f3cf-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:59.008370 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.008345 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxdz\" (UniqueName: \"kubernetes.io/projected/b4edde0d-3114-4b3f-ab1f-d41ac10308e4-kube-api-access-spxdz\") pod \"kserve-controller-manager-69fc866d76-9k4q8\" (UID: \"b4edde0d-3114-4b3f-ab1f-d41ac10308e4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:59.009037 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.009018 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrpvd\" (UniqueName: \"kubernetes.io/projected/05694f94-1d92-4b68-bb8f-84445636f3cf-kube-api-access-vrpvd\") pod \"llmisvc-controller-manager-864bfd7bc9-xzgkj\" (UID: \"05694f94-1d92-4b68-bb8f-84445636f3cf\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:59.095830 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.095729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:36:59.114837 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.114793 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:36:59.244046 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.244015 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj"] Jun 11 14:36:59.246914 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:59.246884 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod05694f94_1d92_4b68_bb8f_84445636f3cf.slice/crio-a9a2a36620aab1327535ef33e28df8a2fddcec616c3bed7eaebdec819460c268 WatchSource:0}: Error finding container a9a2a36620aab1327535ef33e28df8a2fddcec616c3bed7eaebdec819460c268: Status 404 returned error can't find the container with id a9a2a36620aab1327535ef33e28df8a2fddcec616c3bed7eaebdec819460c268 Jun 11 14:36:59.263113 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.263087 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-9k4q8"] Jun 11 14:36:59.265653 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:36:59.265618 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4edde0d_3114_4b3f_ab1f_d41ac10308e4.slice/crio-897f7e5257659f8c2db3c7dca58be1ca88b43d9a48c69caa2e406727cdceb8c7 WatchSource:0}: Error finding container 897f7e5257659f8c2db3c7dca58be1ca88b43d9a48c69caa2e406727cdceb8c7: Status 404 returned error can't find the container with id 897f7e5257659f8c2db3c7dca58be1ca88b43d9a48c69caa2e406727cdceb8c7 Jun 11 14:36:59.999270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:36:59.999235 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" event={"ID":"05694f94-1d92-4b68-bb8f-84445636f3cf","Type":"ContainerStarted","Data":"a9a2a36620aab1327535ef33e28df8a2fddcec616c3bed7eaebdec819460c268"} Jun 11 14:37:00.000529 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:00.000504 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" event={"ID":"b4edde0d-3114-4b3f-ab1f-d41ac10308e4","Type":"ContainerStarted","Data":"897f7e5257659f8c2db3c7dca58be1ca88b43d9a48c69caa2e406727cdceb8c7"} Jun 11 14:37:00.042400 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:00.042360 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:00.142603 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:00.142565 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:03.098391 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:03.098347 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:03.193866 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:03.193783 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:03.974728 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:03.974701 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-x2f2t" Jun 11 14:37:04.019773 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.019746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" event={"ID":"05694f94-1d92-4b68-bb8f-84445636f3cf","Type":"ContainerStarted","Data":"c35f97ac404b39fa2cef522c1d39d66ad0ce7e2d9d0e0bbcfb80f07b6a17c24f"} Jun 11 14:37:04.019958 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.019821 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:37:04.021322 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.021291 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" event={"ID":"b4edde0d-3114-4b3f-ab1f-d41ac10308e4","Type":"ContainerStarted","Data":"8e2d1149cd00e7ade56567b902babd59d10ddb52206d4e0c414772679f9e9303"} Jun 11 14:37:04.021417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.021406 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:37:04.085253 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.085205 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" podStartSLOduration=2.090762333 podStartE2EDuration="6.085187583s" totalImagesPullingTime="3.99442525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:04.084795383 +0000 UTC m=+558.510788062" watchObservedRunningTime="2026-06-11 14:37:04.085187583 +0000 UTC m=+558.511180258" Jun 11 14:37:04.166096 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.166046 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" podStartSLOduration=2.188986608 podStartE2EDuration="6.166028472s" totalImagesPullingTime="3.977041864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:04.165914007 +0000 UTC m=+558.591906686" watchObservedRunningTime="2026-06-11 14:37:04.166028472 +0000 UTC m=+558.592021148" Jun 11 14:37:04.835135 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.835099 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52"] Jun 11 14:37:04.838144 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.838129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:04.875423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.875399 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:37:04.875566 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.875548 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:37:04.875694 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.875676 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:37:04.936088 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.936053 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52"] Jun 11 14:37:04.944698 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.944674 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:04.944839 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.944704 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4g4j\" (UniqueName: \"kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:04.944839 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:04.944726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.031435 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.031400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:05.046104 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.046077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4g4j\" (UniqueName: \"kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.046236 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.046108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.046236 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.046167 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.046486 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.046467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.046543 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.046499 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.061500 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.061472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4g4j\" (UniqueName: \"kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.146146 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.146071 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:05.189049 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.189008 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:05.300181 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.300152 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52"] Jun 11 14:37:05.303017 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:37:05.302989 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6311ca8_49d3_44c4_af70_a2527c37a441.slice/crio-0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e WatchSource:0}: Error finding container 0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e: Status 404 returned error can't find the container with id 0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e Jun 11 14:37:05.320061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.320037 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:05.745773 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.745685 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:05.918731 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:05.918699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:06.030935 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:06.030901 2566 generic.go:356] "Generic (PLEG): container finished" podID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerID="0f28372b6030b97e9a9b8ee4b89eae19da6fb19f263017f3e8e66b07f76662aa" exitCode=0 Jun 11 14:37:06.031121 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:06.030987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" event={"ID":"a6311ca8-49d3-44c4-af70-a2527c37a441","Type":"ContainerDied","Data":"0f28372b6030b97e9a9b8ee4b89eae19da6fb19f263017f3e8e66b07f76662aa"} Jun 11 14:37:06.031121 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:06.031038 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" event={"ID":"a6311ca8-49d3-44c4-af70-a2527c37a441","Type":"ContainerStarted","Data":"0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e"} Jun 11 14:37:07.037113 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:07.037073 2566 generic.go:356] "Generic (PLEG): container finished" podID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerID="f2215b00771fbafb2b6818e27e97fdb04db8b9ef568f0e413412b7d1cf6d78cd" exitCode=0 Jun 11 14:37:07.037558 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:07.037148 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" event={"ID":"a6311ca8-49d3-44c4-af70-a2527c37a441","Type":"ContainerDied","Data":"f2215b00771fbafb2b6818e27e97fdb04db8b9ef568f0e413412b7d1cf6d78cd"} Jun 11 14:37:08.043603 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.043568 2566 generic.go:356] "Generic (PLEG): container finished" podID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerID="35dc788fb8c1f3c2cc95f662a6a3cfe90417dbaee640dcfd0d748d5cc2bdb0e3" exitCode=0 Jun 11 14:37:08.043994 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.043641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" event={"ID":"a6311ca8-49d3-44c4-af70-a2527c37a441","Type":"ContainerDied","Data":"35dc788fb8c1f3c2cc95f662a6a3cfe90417dbaee640dcfd0d748d5cc2bdb0e3"} Jun 11 14:37:08.330487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.330408 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz"] Jun 11 14:37:08.333521 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.333504 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.336480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.336459 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 14:37:08.336955 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.336936 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 14:37:08.337059 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.337029 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ldjs9\"" Jun 11 14:37:08.349137 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.349109 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz"] Jun 11 14:37:08.473139 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.473098 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f1c4069e-f116-472c-84b5-7a7cc1734aa4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.473330 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.473164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgdr\" (UniqueName: \"kubernetes.io/projected/f1c4069e-f116-472c-84b5-7a7cc1734aa4-kube-api-access-xrgdr\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.574484 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.574450 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgdr\" (UniqueName: \"kubernetes.io/projected/f1c4069e-f116-472c-84b5-7a7cc1734aa4-kube-api-access-xrgdr\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.574625 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.574508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f1c4069e-f116-472c-84b5-7a7cc1734aa4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.577189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.577168 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f1c4069e-f116-472c-84b5-7a7cc1734aa4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.584418 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.584357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgdr\" (UniqueName: \"kubernetes.io/projected/f1c4069e-f116-472c-84b5-7a7cc1734aa4-kube-api-access-xrgdr\") pod \"servicemesh-operator3-57f65f65fb-ds9qz\" (UID: \"f1c4069e-f116-472c-84b5-7a7cc1734aa4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.643060 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.643030 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:08.789534 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:08.789498 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz"] Jun 11 14:37:08.793921 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:37:08.793893 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c4069e_f116_472c_84b5_7a7cc1734aa4.slice/crio-c859070d310f5e361610988d70122880fb2646579a342419dea62d305d5f271b WatchSource:0}: Error finding container c859070d310f5e361610988d70122880fb2646579a342419dea62d305d5f271b: Status 404 returned error can't find the container with id c859070d310f5e361610988d70122880fb2646579a342419dea62d305d5f271b Jun 11 14:37:09.048995 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.048964 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" event={"ID":"f1c4069e-f116-472c-84b5-7a7cc1734aa4","Type":"ContainerStarted","Data":"c859070d310f5e361610988d70122880fb2646579a342419dea62d305d5f271b"} Jun 11 14:37:09.159268 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.159245 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:09.280189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.280159 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util\") pod \"a6311ca8-49d3-44c4-af70-a2527c37a441\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " Jun 11 14:37:09.280340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.280200 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4g4j\" (UniqueName: \"kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j\") pod \"a6311ca8-49d3-44c4-af70-a2527c37a441\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " Jun 11 14:37:09.280340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.280253 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle\") pod \"a6311ca8-49d3-44c4-af70-a2527c37a441\" (UID: \"a6311ca8-49d3-44c4-af70-a2527c37a441\") " Jun 11 14:37:09.281076 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.281051 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle" (OuterVolumeSpecName: "bundle") pod "a6311ca8-49d3-44c4-af70-a2527c37a441" (UID: "a6311ca8-49d3-44c4-af70-a2527c37a441"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:37:09.282327 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.282302 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j" (OuterVolumeSpecName: "kube-api-access-c4g4j") pod "a6311ca8-49d3-44c4-af70-a2527c37a441" (UID: "a6311ca8-49d3-44c4-af70-a2527c37a441"). InnerVolumeSpecName "kube-api-access-c4g4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:37:09.285453 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.285429 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util" (OuterVolumeSpecName: "util") pod "a6311ca8-49d3-44c4-af70-a2527c37a441" (UID: "a6311ca8-49d3-44c4-af70-a2527c37a441"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:37:09.381165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.381086 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:37:09.381165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.381116 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6311ca8-49d3-44c4-af70-a2527c37a441-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:37:09.381165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:09.381128 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4g4j\" (UniqueName: \"kubernetes.io/projected/a6311ca8-49d3-44c4-af70-a2527c37a441-kube-api-access-c4g4j\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:37:10.060931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:10.060898 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" Jun 11 14:37:10.060931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:10.060920 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atxk52" event={"ID":"a6311ca8-49d3-44c4-af70-a2527c37a441","Type":"ContainerDied","Data":"0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e"} Jun 11 14:37:10.061452 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:10.061002 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ec6d727cd2998e654a995185f061780ce273ab6316c228f21b036db5b3e7d1e" Jun 11 14:37:12.071279 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:12.071242 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" event={"ID":"f1c4069e-f116-472c-84b5-7a7cc1734aa4","Type":"ContainerStarted","Data":"7a183f72b3ac1f6532f092e0fc0fe67f8f13aa414b8da73a9556ab6e7f6ee0bb"} Jun 11 14:37:12.071685 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:12.071377 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:12.092429 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:12.092368 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" podStartSLOduration=1.655333756 podStartE2EDuration="4.092350881s" totalImagesPullingTime="2.437017125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:12.09110133 +0000 UTC m=+566.517094016" watchObservedRunningTime="2026-06-11 14:37:12.092350881 +0000 UTC m=+566.518343558" Jun 11 14:37:16.497398 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:16.497364 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:16.597943 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:16.597913 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:17.421369 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421338 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94"] Jun 11 14:37:17.421619 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421607 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="util" Jun 11 14:37:17.421658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421621 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="util" Jun 11 14:37:17.421658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421640 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="pull" Jun 11 14:37:17.421658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421645 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="pull" Jun 11 14:37:17.421658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421654 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="extract" Jun 11 14:37:17.421658 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421659 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="extract" Jun 11 14:37:17.421826 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.421713 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6311ca8-49d3-44c4-af70-a2527c37a441" containerName="extract" Jun 11 14:37:17.424620 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.424601 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.432981 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.432957 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 14:37:17.433113 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.433008 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 14:37:17.433273 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.433258 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6qtf6\"" Jun 11 14:37:17.433674 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.433653 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 14:37:17.433913 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.433894 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 14:37:17.435120 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.435097 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:17.461825 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.461786 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94"] Jun 11 14:37:17.536134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.536102 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:17.546110 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546186 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58f83b7-5111-476c-a239-dfc2938e0c30-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546186 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrh4m\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-kube-api-access-wrh4m\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546186 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546200 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.546299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.546287 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647164 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrh4m\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-kube-api-access-wrh4m\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647164 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647358 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647569 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647539 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647637 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647622 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647732 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.647796 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58f83b7-5111-476c-a239-dfc2938e0c30-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.648016 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.647992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.649870 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.649837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.649981 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.649927 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.650447 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.650430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c58f83b7-5111-476c-a239-dfc2938e0c30-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.650643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.650624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.656286 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.656256 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.656609 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.656587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrh4m\" (UniqueName: \"kubernetes.io/projected/c58f83b7-5111-476c-a239-dfc2938e0c30-kube-api-access-wrh4m\") pod \"istiod-openshift-gateway-75c67f8887-5jn94\" (UID: \"c58f83b7-5111-476c-a239-dfc2938e0c30\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.733643 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.733551 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:17.877532 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:17.877502 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94"] Jun 11 14:37:17.878447 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:37:17.878418 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58f83b7_5111_476c_a239_dfc2938e0c30.slice/crio-c641eac81c2dcd7cc7868526feddf7ac8e6a8c8d0f729c480c94f2e8b0d35a90 WatchSource:0}: Error finding container c641eac81c2dcd7cc7868526feddf7ac8e6a8c8d0f729c480c94f2e8b0d35a90: Status 404 returned error can't find the container with id c641eac81c2dcd7cc7868526feddf7ac8e6a8c8d0f729c480c94f2e8b0d35a90 Jun 11 14:37:18.091599 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:18.091567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:18.101947 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:18.101918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" event={"ID":"c58f83b7-5111-476c-a239-dfc2938e0c30","Type":"ContainerStarted","Data":"c641eac81c2dcd7cc7868526feddf7ac8e6a8c8d0f729c480c94f2e8b0d35a90"} Jun 11 14:37:20.414526 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:20.414482 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:37:20.414781 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:20.414553 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:37:20.903003 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:20.902962 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:20.987519 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:20.987481 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:21.118180 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.118146 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" event={"ID":"c58f83b7-5111-476c-a239-dfc2938e0c30","Type":"ContainerStarted","Data":"4994f85c76bc85d2c728c2f5a1b7ae3e880b4e71118765406fb82fd5d51293c9"} Jun 11 14:37:21.118350 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.118311 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:21.119844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.119818 2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-5jn94 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 11 14:37:21.119980 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.119865 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" podUID="c58f83b7-5111-476c-a239-dfc2938e0c30" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:37:21.156352 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.156260 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" podStartSLOduration=1.622416898 podStartE2EDuration="4.156244498s" totalImagesPullingTime="2.5338276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:21.154370339 +0000 UTC m=+575.580363018" watchObservedRunningTime="2026-06-11 14:37:21.156244498 +0000 UTC m=+575.582237175" Jun 11 14:37:21.243266 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.243230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:21.402510 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.402475 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:21.538482 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:21.538450 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:22.123243 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:22.123215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-5jn94" Jun 11 14:37:23.078313 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:23.078285 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ds9qz" Jun 11 14:37:26.772665 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.772633 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-q75cb"] Jun 11 14:37:26.777305 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.777287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:26.779890 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.779866 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 14:37:26.779890 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.779891 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vdb6f\"" Jun 11 14:37:26.786606 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.786580 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-q75cb"] Jun 11 14:37:26.801844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.801796 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:26.922183 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.922142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmnc4\" (UniqueName: \"kubernetes.io/projected/65ed0706-3496-4d35-b571-7ec63020f799-kube-api-access-kmnc4\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:26.922355 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:26.922203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/65ed0706-3496-4d35-b571-7ec63020f799-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.022857 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.022823 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/65ed0706-3496-4d35-b571-7ec63020f799-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.022978 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.022919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmnc4\" (UniqueName: \"kubernetes.io/projected/65ed0706-3496-4d35-b571-7ec63020f799-kube-api-access-kmnc4\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.023554 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.023536 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/65ed0706-3496-4d35-b571-7ec63020f799-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.031850 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.031828 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmnc4\" (UniqueName: \"kubernetes.io/projected/65ed0706-3496-4d35-b571-7ec63020f799-kube-api-access-kmnc4\") pod \"dashboard-redirect-67cd5f7d45-q75cb\" (UID: \"65ed0706-3496-4d35-b571-7ec63020f799\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.088337 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.088287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" Jun 11 14:37:27.218106 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:27.218080 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-q75cb"] Jun 11 14:37:27.220690 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:37:27.220650 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ed0706_3496_4d35_b571_7ec63020f799.slice/crio-3b6ab78d58fdb2dab1d37f169fe46e63a701604ad254869dce4ce98a0f518e88 WatchSource:0}: Error finding container 3b6ab78d58fdb2dab1d37f169fe46e63a701604ad254869dce4ce98a0f518e88: Status 404 returned error can't find the container with id 3b6ab78d58fdb2dab1d37f169fe46e63a701604ad254869dce4ce98a0f518e88 Jun 11 14:37:28.151553 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:28.151512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" event={"ID":"65ed0706-3496-4d35-b571-7ec63020f799","Type":"ContainerStarted","Data":"3b6ab78d58fdb2dab1d37f169fe46e63a701604ad254869dce4ce98a0f518e88"} Jun 11 14:37:32.172270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:32.172231 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" event={"ID":"65ed0706-3496-4d35-b571-7ec63020f799","Type":"ContainerStarted","Data":"16235ca70abfa4bc6ca90537e9d46e9cb3fcf66565cca95f8285d3b975d48bc7"} Jun 11 14:37:32.190685 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:32.190636 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67cd5f7d45-q75cb" podStartSLOduration=1.426705411 podStartE2EDuration="6.190620617s" totalImagesPullingTime="4.763915206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:32.188509316 +0000 UTC m=+586.614502121" watchObservedRunningTime="2026-06-11 14:37:32.190620617 +0000 UTC m=+586.616613293" Jun 11 14:37:35.027386 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:35.027359 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-xzgkj" Jun 11 14:37:35.030427 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:35.030411 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-9k4q8" Jun 11 14:37:46.047119 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:46.047089 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:37:46.047841 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:46.047819 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:37:47.361368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:47.361335 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:47.505848 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:47.505791 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:37:47.611945 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:37:47.611861 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:02.828202 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.828123 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg"] Jun 11 14:38:02.831474 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.831456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.834280 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.834259 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:38:02.835286 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.835269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:38:02.835377 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.835292 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xt662\"" Jun 11 14:38:02.843916 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.843885 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg"] Jun 11 14:38:02.888094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.888062 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.888270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.888103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkvzg\" (UniqueName: \"kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.888270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.888131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.989398 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.989363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.989398 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.989402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkvzg\" (UniqueName: \"kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.989614 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.989444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.989757 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.989736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.989853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.989767 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:02.998108 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:02.998085 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkvzg\" (UniqueName: \"kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:03.140489 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.140404 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:03.296550 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.296519 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg"] Jun 11 14:38:03.299687 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:03.299662 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dad5376_ab1b_4eac_8a7d_8d2953dd3efc.slice/crio-7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e WatchSource:0}: Error finding container 7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e: Status 404 returned error can't find the container with id 7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e Jun 11 14:38:03.311690 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.311661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" event={"ID":"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc","Type":"ContainerStarted","Data":"7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e"} Jun 11 14:38:03.465517 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.465484 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc"] Jun 11 14:38:03.471614 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.471587 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.478433 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.478408 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc"] Jun 11 14:38:03.492920 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.492890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.493066 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.492956 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brls8\" (UniqueName: \"kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.493066 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.493014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.594262 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.594226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.594423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.594270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.594423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.594308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brls8\" (UniqueName: \"kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.594624 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.594605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.594663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.594628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.603578 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.603553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brls8\" (UniqueName: \"kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.782443 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.782408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:03.931058 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:03.931034 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc"] Jun 11 14:38:03.934754 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:03.934725 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee10793b_29ec_4c45_b6e5_5fea3c955bd4.slice/crio-a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72 WatchSource:0}: Error finding container a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72: Status 404 returned error can't find the container with id a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72 Jun 11 14:38:04.038957 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.038927 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql"] Jun 11 14:38:04.098527 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.098502 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql"] Jun 11 14:38:04.098666 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.098646 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.199747 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.199713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.199747 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.199752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5zs6\" (UniqueName: \"kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.199974 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.199782 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.300293 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.300194 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.300293 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.300242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5zs6\" (UniqueName: \"kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.300494 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.300365 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.300680 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.300660 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.300745 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.300671 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.310113 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.310091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5zs6\" (UniqueName: \"kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.317786 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.317757 2566 generic.go:356] "Generic (PLEG): container finished" podID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerID="2c53318baa2e2971df87d4907c275760174d23a9fff65779b2e9ec954ec4c306" exitCode=0 Jun 11 14:38:04.317920 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.317835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerDied","Data":"2c53318baa2e2971df87d4907c275760174d23a9fff65779b2e9ec954ec4c306"} Jun 11 14:38:04.317920 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.317885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerStarted","Data":"a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72"} Jun 11 14:38:04.319390 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.319371 2566 generic.go:356] "Generic (PLEG): container finished" podID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerID="46cd7a332582f46f0803fbb4d962dc8f913a457e12f8d8950fcc8b45b8cc6c4c" exitCode=0 Jun 11 14:38:04.319472 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.319413 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" event={"ID":"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc","Type":"ContainerDied","Data":"46cd7a332582f46f0803fbb4d962dc8f913a457e12f8d8950fcc8b45b8cc6c4c"} Jun 11 14:38:04.408072 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.408040 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:04.462461 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.462430 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk"] Jun 11 14:38:04.477718 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.477685 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.482340 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.482313 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk"] Jun 11 14:38:04.502494 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.502461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prjj5\" (UniqueName: \"kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.502640 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.502523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.502640 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.502568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.597630 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.597605 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql"] Jun 11 14:38:04.599558 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:04.599517 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72505c0_b749_4228_a9d2_0de9805665ed.slice/crio-81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec WatchSource:0}: Error finding container 81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec: Status 404 returned error can't find the container with id 81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec Jun 11 14:38:04.603755 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.603732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prjj5\" (UniqueName: \"kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.603858 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.603766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.603858 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.603792 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.604187 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.604166 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.604326 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.604305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.622415 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.622388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prjj5\" (UniqueName: \"kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.790344 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.790313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:04.947281 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:04.947254 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk"] Jun 11 14:38:05.017300 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:05.017252 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9785f694_b0b4_4ce3_bafd_6f18fefdf75e.slice/crio-2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca WatchSource:0}: Error finding container 2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca: Status 404 returned error can't find the container with id 2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca Jun 11 14:38:05.327013 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.326984 2566 generic.go:356] "Generic (PLEG): container finished" podID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerID="581d92d080d190df6e265bfa7f1157568e9798da60e5c1c48d3f961b3169b659" exitCode=0 Jun 11 14:38:05.327132 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.327058 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" event={"ID":"9785f694-b0b4-4ce3-bafd-6f18fefdf75e","Type":"ContainerDied","Data":"581d92d080d190df6e265bfa7f1157568e9798da60e5c1c48d3f961b3169b659"} Jun 11 14:38:05.327132 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.327119 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" event={"ID":"9785f694-b0b4-4ce3-bafd-6f18fefdf75e","Type":"ContainerStarted","Data":"2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca"} Jun 11 14:38:05.328950 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.328926 2566 generic.go:356] "Generic (PLEG): container finished" podID="c72505c0-b749-4228-a9d2-0de9805665ed" containerID="76cb06f8fd165112e26ca6be62f927b1ad63949969c01c5e0f079862a6e6c738" exitCode=0 Jun 11 14:38:05.329071 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.328992 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" event={"ID":"c72505c0-b749-4228-a9d2-0de9805665ed","Type":"ContainerDied","Data":"76cb06f8fd165112e26ca6be62f927b1ad63949969c01c5e0f079862a6e6c738"} Jun 11 14:38:05.329071 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.329038 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" event={"ID":"c72505c0-b749-4228-a9d2-0de9805665ed","Type":"ContainerStarted","Data":"81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec"} Jun 11 14:38:05.331219 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:05.331076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerStarted","Data":"9311c9e349c7dc353aafc31ab1dc8487fdf4122ae7fe208c112598dadbf9a2b3"} Jun 11 14:38:06.337130 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.337086 2566 generic.go:356] "Generic (PLEG): container finished" podID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerID="0bed6629f19edaca001db584e9f0bcaa42a5b016af1c2f91891b58824d56b138" exitCode=0 Jun 11 14:38:06.337527 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.337192 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" event={"ID":"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc","Type":"ContainerDied","Data":"0bed6629f19edaca001db584e9f0bcaa42a5b016af1c2f91891b58824d56b138"} Jun 11 14:38:06.339201 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.339176 2566 generic.go:356] "Generic (PLEG): container finished" podID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerID="dc0b167a5bdfb4a4b334e9fe1afe5c84f773e8577c6843d71e97982c834d9c41" exitCode=0 Jun 11 14:38:06.339317 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.339285 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" event={"ID":"9785f694-b0b4-4ce3-bafd-6f18fefdf75e","Type":"ContainerDied","Data":"dc0b167a5bdfb4a4b334e9fe1afe5c84f773e8577c6843d71e97982c834d9c41"} Jun 11 14:38:06.341156 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.341136 2566 generic.go:356] "Generic (PLEG): container finished" podID="c72505c0-b749-4228-a9d2-0de9805665ed" containerID="97bc95105fe8883551b006e635b91d2e92b4d669a9a371e7fa661876ce27dbdd" exitCode=0 Jun 11 14:38:06.341235 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.341164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" event={"ID":"c72505c0-b749-4228-a9d2-0de9805665ed","Type":"ContainerDied","Data":"97bc95105fe8883551b006e635b91d2e92b4d669a9a371e7fa661876ce27dbdd"} Jun 11 14:38:06.343134 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.343116 2566 generic.go:356] "Generic (PLEG): container finished" podID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerID="9311c9e349c7dc353aafc31ab1dc8487fdf4122ae7fe208c112598dadbf9a2b3" exitCode=0 Jun 11 14:38:06.343216 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:06.343165 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerDied","Data":"9311c9e349c7dc353aafc31ab1dc8487fdf4122ae7fe208c112598dadbf9a2b3"} Jun 11 14:38:07.349797 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.349760 2566 generic.go:356] "Generic (PLEG): container finished" podID="c72505c0-b749-4228-a9d2-0de9805665ed" containerID="a5fad3ce07ad536e9df0c7338d154f3344ad4936a0df18635b3144ba75951786" exitCode=0 Jun 11 14:38:07.350265 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.349849 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" event={"ID":"c72505c0-b749-4228-a9d2-0de9805665ed","Type":"ContainerDied","Data":"a5fad3ce07ad536e9df0c7338d154f3344ad4936a0df18635b3144ba75951786"} Jun 11 14:38:07.351789 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.351767 2566 generic.go:356] "Generic (PLEG): container finished" podID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerID="922316bdebf0c7ff3d696ad31407eee5261740d130d2d79984bcc4806404ebb6" exitCode=0 Jun 11 14:38:07.351928 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.351823 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerDied","Data":"922316bdebf0c7ff3d696ad31407eee5261740d130d2d79984bcc4806404ebb6"} Jun 11 14:38:07.353555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.353536 2566 generic.go:356] "Generic (PLEG): container finished" podID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerID="7df136661ab44a13586a60d8ac65bf53553d38eac51754f01434d25818887b8f" exitCode=0 Jun 11 14:38:07.353677 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.353612 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" event={"ID":"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc","Type":"ContainerDied","Data":"7df136661ab44a13586a60d8ac65bf53553d38eac51754f01434d25818887b8f"} Jun 11 14:38:07.355410 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.355391 2566 generic.go:356] "Generic (PLEG): container finished" podID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerID="711a6832200cd146be6dc95dd0defe1a082859a5c92420a0c6f17bb74d2110e3" exitCode=0 Jun 11 14:38:07.355483 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:07.355421 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" event={"ID":"9785f694-b0b4-4ce3-bafd-6f18fefdf75e","Type":"ContainerDied","Data":"711a6832200cd146be6dc95dd0defe1a082859a5c92420a0c6f17bb74d2110e3"} Jun 11 14:38:08.521473 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.521445 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:08.573795 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.573762 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:08.577155 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.577135 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:08.580931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.580915 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:08.636895 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.636788 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brls8\" (UniqueName: \"kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8\") pod \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " Jun 11 14:38:08.636895 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.636863 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prjj5\" (UniqueName: \"kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5\") pod \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.636910 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle\") pod \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.636931 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle\") pod \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.636995 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util\") pod \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\" (UID: \"9785f694-b0b4-4ce3-bafd-6f18fefdf75e\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637028 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util\") pod \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637055 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle\") pod \"c72505c0-b749-4228-a9d2-0de9805665ed\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " Jun 11 14:38:08.637101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637083 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util\") pod \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " Jun 11 14:38:08.637423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637148 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util\") pod \"c72505c0-b749-4228-a9d2-0de9805665ed\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " Jun 11 14:38:08.637423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637182 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5zs6\" (UniqueName: \"kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6\") pod \"c72505c0-b749-4228-a9d2-0de9805665ed\" (UID: \"c72505c0-b749-4228-a9d2-0de9805665ed\") " Jun 11 14:38:08.637423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637212 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkvzg\" (UniqueName: \"kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg\") pod \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\" (UID: \"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc\") " Jun 11 14:38:08.637423 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637246 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle\") pod \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\" (UID: \"ee10793b-29ec-4c45-b6e5-5fea3c955bd4\") " Jun 11 14:38:08.637958 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.637842 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle" (OuterVolumeSpecName: "bundle") pod "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" (UID: "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.638475 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.638227 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle" (OuterVolumeSpecName: "bundle") pod "ee10793b-29ec-4c45-b6e5-5fea3c955bd4" (UID: "ee10793b-29ec-4c45-b6e5-5fea3c955bd4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.638475 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.638299 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle" (OuterVolumeSpecName: "bundle") pod "c72505c0-b749-4228-a9d2-0de9805665ed" (UID: "c72505c0-b749-4228-a9d2-0de9805665ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.639863 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.639834 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5" (OuterVolumeSpecName: "kube-api-access-prjj5") pod "9785f694-b0b4-4ce3-bafd-6f18fefdf75e" (UID: "9785f694-b0b4-4ce3-bafd-6f18fefdf75e"). InnerVolumeSpecName "kube-api-access-prjj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:08.639963 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.639930 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8" (OuterVolumeSpecName: "kube-api-access-brls8") pod "ee10793b-29ec-4c45-b6e5-5fea3c955bd4" (UID: "ee10793b-29ec-4c45-b6e5-5fea3c955bd4"). InnerVolumeSpecName "kube-api-access-brls8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:08.640839 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.640783 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6" (OuterVolumeSpecName: "kube-api-access-v5zs6") pod "c72505c0-b749-4228-a9d2-0de9805665ed" (UID: "c72505c0-b749-4228-a9d2-0de9805665ed"). InnerVolumeSpecName "kube-api-access-v5zs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:08.641975 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.641942 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg" (OuterVolumeSpecName: "kube-api-access-wkvzg") pod "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" (UID: "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc"). InnerVolumeSpecName "kube-api-access-wkvzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:08.642199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.642178 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle" (OuterVolumeSpecName: "bundle") pod "9785f694-b0b4-4ce3-bafd-6f18fefdf75e" (UID: "9785f694-b0b4-4ce3-bafd-6f18fefdf75e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.644543 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.644506 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util" (OuterVolumeSpecName: "util") pod "9785f694-b0b4-4ce3-bafd-6f18fefdf75e" (UID: "9785f694-b0b4-4ce3-bafd-6f18fefdf75e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.645470 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.645432 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util" (OuterVolumeSpecName: "util") pod "c72505c0-b749-4228-a9d2-0de9805665ed" (UID: "c72505c0-b749-4228-a9d2-0de9805665ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.645555 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.645536 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util" (OuterVolumeSpecName: "util") pod "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" (UID: "6dad5376-ab1b-4eac-8a7d-8d2953dd3efc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.647135 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.647113 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util" (OuterVolumeSpecName: "util") pod "ee10793b-29ec-4c45-b6e5-5fea3c955bd4" (UID: "ee10793b-29ec-4c45-b6e5-5fea3c955bd4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:08.737935 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737904 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.737935 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737930 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.737935 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737939 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737947 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737954 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c72505c0-b749-4228-a9d2-0de9805665ed-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737963 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5zs6\" (UniqueName: \"kubernetes.io/projected/c72505c0-b749-4228-a9d2-0de9805665ed-kube-api-access-v5zs6\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737973 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkvzg\" (UniqueName: \"kubernetes.io/projected/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-kube-api-access-wkvzg\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737981 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737989 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brls8\" (UniqueName: \"kubernetes.io/projected/ee10793b-29ec-4c45-b6e5-5fea3c955bd4-kube-api-access-brls8\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.737997 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prjj5\" (UniqueName: \"kubernetes.io/projected/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-kube-api-access-prjj5\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.738004 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6dad5376-ab1b-4eac-8a7d-8d2953dd3efc-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:08.738123 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:08.738013 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9785f694-b0b4-4ce3-bafd-6f18fefdf75e-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:09.373309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.373276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" event={"ID":"6dad5376-ab1b-4eac-8a7d-8d2953dd3efc","Type":"ContainerDied","Data":"7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e"} Jun 11 14:38:09.373491 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.373354 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7513abca90268f71cdec59362a8ff9ab4499f25bfbfb2c6c63ca4abcf93e2e7e" Jun 11 14:38:09.373491 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.373288 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg" Jun 11 14:38:09.375204 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.375183 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" Jun 11 14:38:09.375320 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.375210 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk" event={"ID":"9785f694-b0b4-4ce3-bafd-6f18fefdf75e","Type":"ContainerDied","Data":"2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca"} Jun 11 14:38:09.375320 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.375255 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b5974cc3b594c0c4ec54a9329a6471dc7aa8c9723f6e17fe72ee79bbb1515ca" Jun 11 14:38:09.377176 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.377161 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" Jun 11 14:38:09.377276 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.377190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql" event={"ID":"c72505c0-b749-4228-a9d2-0de9805665ed","Type":"ContainerDied","Data":"81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec"} Jun 11 14:38:09.377276 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.377217 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81aa2bd0b81702b23a65f9a94871edd0a7e1fd2628328cd112eac755bde5ceec" Jun 11 14:38:09.379145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.379123 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" event={"ID":"ee10793b-29ec-4c45-b6e5-5fea3c955bd4","Type":"ContainerDied","Data":"a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72"} Jun 11 14:38:09.379245 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.379155 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a764cb1e44bb90c8dc4023bf6d6dce5d0c5a094935ba9b1237fc724071e67f72" Jun 11 14:38:09.379245 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:09.379185 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc" Jun 11 14:38:10.556312 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:10.556281 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:11.155285 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:11.155250 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:12.215780 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:12.215748 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:12.317949 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:12.317914 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:15.422255 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:15.422213 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:17.835766 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:17.835731 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:18.038698 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:18.038666 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:20.270785 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:20.270744 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:20.385378 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:20.385334 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:23.144796 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:23.144760 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:24.029428 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029393 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc"] Jun 11 14:38:24.029735 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029719 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="extract" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029738 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="extract" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029755 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="util" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029763 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="util" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029777 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="extract" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029786 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="extract" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029823 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="util" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029833 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="util" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029844 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="extract" Jun 11 14:38:24.029849 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029852 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029861 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="util" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029869 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="util" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029876 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029884 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029894 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029902 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029911 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029918 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029936 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029944 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029955 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="util" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029963 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="util" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029974 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.029982 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="pull" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.030084 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee10793b-29ec-4c45-b6e5-5fea3c955bd4" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.030099 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72505c0-b749-4228-a9d2-0de9805665ed" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.030109 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dad5376-ab1b-4eac-8a7d-8d2953dd3efc" containerName="extract" Jun 11 14:38:24.030267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.030119 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9785f694-b0b4-4ce3-bafd-6f18fefdf75e" containerName="extract" Jun 11 14:38:24.034899 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.034876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.043473 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.043452 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:38:24.043563 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.043461 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:38:24.045221 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.045205 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkrxw\"" Jun 11 14:38:24.050618 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.050599 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc"] Jun 11 14:38:24.147609 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.147572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwp6l\" (UniqueName: \"kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.148001 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.147630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.248931 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.248893 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.249079 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.248962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwp6l\" (UniqueName: \"kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.249304 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.249283 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.262117 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.262095 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwp6l\" (UniqueName: \"kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.345189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.345117 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:24.513283 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.513260 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc"] Jun 11 14:38:24.515852 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:24.515825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39257e8_da64_4dad_8340_e8c3f5827dd5.slice/crio-25751b7e06f029a05f2b569a6eb2539d3613083b141d8d615e694db4dbcac256 WatchSource:0}: Error finding container 25751b7e06f029a05f2b569a6eb2539d3613083b141d8d615e694db4dbcac256: Status 404 returned error can't find the container with id 25751b7e06f029a05f2b569a6eb2539d3613083b141d8d615e694db4dbcac256 Jun 11 14:38:24.630726 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.630643 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:24.730250 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:24.730215 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:25.214146 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:25.214115 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:25.333520 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:25.333474 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:25.465897 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:25.465825 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" event={"ID":"f39257e8-da64-4dad-8340-e8c3f5827dd5","Type":"ContainerStarted","Data":"25751b7e06f029a05f2b569a6eb2539d3613083b141d8d615e694db4dbcac256"} Jun 11 14:38:25.588366 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:25.588329 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:25.715160 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:25.715122 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:27.393778 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:27.393742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:27.493489 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:27.493447 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:29.357346 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:29.357312 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:29.519281 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:29.519249 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:31.547865 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:31.547837 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:32.505032 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:32.504993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" event={"ID":"f39257e8-da64-4dad-8340-e8c3f5827dd5","Type":"ContainerStarted","Data":"b41251947a26733fc7d611f76259cf20a1ceff2b798df602fc2ef085b47bd1f3"} Jun 11 14:38:32.505217 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:32.505072 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:32.546424 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:32.546369 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" podStartSLOduration=2.600605769 podStartE2EDuration="9.546353877s" totalImagesPullingTime="6.945748108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:32.545167317 +0000 UTC m=+646.971159993" watchObservedRunningTime="2026-06-11 14:38:32.546353877 +0000 UTC m=+646.972346552" Jun 11 14:38:33.403261 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:33.403222 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:33.509963 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:33.509933 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:34.317177 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:34.317143 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:34.507057 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:34.507023 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:35.420712 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:35.420678 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:35.523255 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:35.523217 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:36.870990 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:36.870945 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:36.965315 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:36.965272 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:43.512493 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:43.512465 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:45.035232 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.035194 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:45.458189 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.458109 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc"] Jun 11 14:38:45.458363 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.458325 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" containerName="manager" containerID="cri-o://b41251947a26733fc7d611f76259cf20a1ceff2b798df602fc2ef085b47bd1f3" gracePeriod=2 Jun 11 14:38:45.478129 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.478101 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc"] Jun 11 14:38:45.576583 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.576553 2566 generic.go:356] "Generic (PLEG): container finished" podID="f39257e8-da64-4dad-8340-e8c3f5827dd5" containerID="b41251947a26733fc7d611f76259cf20a1ceff2b798df602fc2ef085b47bd1f3" exitCode=0 Jun 11 14:38:45.577529 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.577507 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:38:45.577883 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.577867 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" containerName="manager" Jun 11 14:38:45.577883 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.577883 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" containerName="manager" Jun 11 14:38:45.578015 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.577948 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" containerName="manager" Jun 11 14:38:45.580770 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.580748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.584072 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:38:45.584043 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" is forbidden: User \"system:node:ip-10-0-128-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-209.ec2.internal' and this object" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.592611 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:38:45.592576 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" is forbidden: User \"system:node:ip-10-0-128-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-209.ec2.internal' and this object" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:45.635095 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.635057 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:38:45.670265 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.670187 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:45.729155 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.729131 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.729285 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.729188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgp5m\" (UniqueName: \"kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.735622 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.735591 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:45.739053 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:38:45.739027 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" is forbidden: User \"system:node:ip-10-0-128-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-209.ec2.internal' and this object" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:45.829989 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.829962 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume\") pod \"f39257e8-da64-4dad-8340-e8c3f5827dd5\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " Jun 11 14:38:45.830165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.830044 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwp6l\" (UniqueName: \"kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l\") pod \"f39257e8-da64-4dad-8340-e8c3f5827dd5\" (UID: \"f39257e8-da64-4dad-8340-e8c3f5827dd5\") " Jun 11 14:38:45.830231 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.830211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.830287 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.830271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgp5m\" (UniqueName: \"kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.830428 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.830404 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f39257e8-da64-4dad-8340-e8c3f5827dd5" (UID: "f39257e8-da64-4dad-8340-e8c3f5827dd5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:38:45.830572 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.830552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.832269 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.832248 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l" (OuterVolumeSpecName: "kube-api-access-vwp6l") pod "f39257e8-da64-4dad-8340-e8c3f5827dd5" (UID: "f39257e8-da64-4dad-8340-e8c3f5827dd5"). InnerVolumeSpecName "kube-api-access-vwp6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:45.864545 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.864523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgp5m\" (UniqueName: \"kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2m2t7\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.891393 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.891367 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:45.909778 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.909750 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:45.931012 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.930977 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f39257e8-da64-4dad-8340-e8c3f5827dd5-extensions-socket-volume\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:45.931012 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:45.931002 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwp6l\" (UniqueName: \"kubernetes.io/projected/f39257e8-da64-4dad-8340-e8c3f5827dd5-kube-api-access-vwp6l\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:38:46.069131 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.069104 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:38:46.071912 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:38:46.071888 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3818366_9e48_44ca_bc07_93c1f6feb484.slice/crio-b2141fb60582b57c88967d058ff11d9e41caa8748986b9a259c84f563f29a149 WatchSource:0}: Error finding container b2141fb60582b57c88967d058ff11d9e41caa8748986b9a259c84f563f29a149: Status 404 returned error can't find the container with id b2141fb60582b57c88967d058ff11d9e41caa8748986b9a259c84f563f29a149 Jun 11 14:38:46.086572 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:38:46.086547 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-t4rqc\" is forbidden: User \"system:node:ip-10-0-128-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-209.ec2.internal' and this object" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:46.087368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.087344 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39257e8-da64-4dad-8340-e8c3f5827dd5" path="/var/lib/kubelet/pods/f39257e8-da64-4dad-8340-e8c3f5827dd5/volumes" Jun 11 14:38:46.141227 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.141201 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:46.582736 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.582700 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" event={"ID":"a3818366-9e48-44ca-bc07-93c1f6feb484","Type":"ContainerStarted","Data":"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45"} Jun 11 14:38:46.582940 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.582765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" event={"ID":"a3818366-9e48-44ca-bc07-93c1f6feb484","Type":"ContainerStarted","Data":"b2141fb60582b57c88967d058ff11d9e41caa8748986b9a259c84f563f29a149"} Jun 11 14:38:46.583005 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.582923 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:38:46.584034 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.584017 2566 scope.go:117] "RemoveContainer" containerID="b41251947a26733fc7d611f76259cf20a1ceff2b798df602fc2ef085b47bd1f3" Jun 11 14:38:46.584034 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.584030 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t4rqc" Jun 11 14:38:46.638305 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:46.638251 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" podStartSLOduration=1.638232986 podStartE2EDuration="1.638232986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:46.638064752 +0000 UTC m=+661.064057438" watchObservedRunningTime="2026-06-11 14:38:46.638232986 +0000 UTC m=+661.064225662" Jun 11 14:38:49.369760 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:49.369722 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:49.544972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:49.544942 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:51.795315 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:51.795275 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:53.113595 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:53.113560 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:53.237466 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:53.237425 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:56.368886 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:56.368852 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:56.940309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:56.940269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:38:57.592452 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:38:57.592426 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:39:05.904673 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:05.904641 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:39:05.905237 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:05.904910 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" containerName="manager" containerID="cri-o://fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45" gracePeriod=10 Jun 11 14:39:06.151146 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.151125 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:39:06.183692 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.183638 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgp5m\" (UniqueName: \"kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m\") pod \"a3818366-9e48-44ca-bc07-93c1f6feb484\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " Jun 11 14:39:06.183692 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.183677 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume\") pod \"a3818366-9e48-44ca-bc07-93c1f6feb484\" (UID: \"a3818366-9e48-44ca-bc07-93c1f6feb484\") " Jun 11 14:39:06.184080 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.184058 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a3818366-9e48-44ca-bc07-93c1f6feb484" (UID: "a3818366-9e48-44ca-bc07-93c1f6feb484"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:39:06.185788 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.185767 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m" (OuterVolumeSpecName: "kube-api-access-vgp5m") pod "a3818366-9e48-44ca-bc07-93c1f6feb484" (UID: "a3818366-9e48-44ca-bc07-93c1f6feb484"). InnerVolumeSpecName "kube-api-access-vgp5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:39:06.284480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.284451 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgp5m\" (UniqueName: \"kubernetes.io/projected/a3818366-9e48-44ca-bc07-93c1f6feb484-kube-api-access-vgp5m\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:39:06.284480 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.284474 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3818366-9e48-44ca-bc07-93c1f6feb484-extensions-socket-volume\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:39:06.685261 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.685225 2566 generic.go:356] "Generic (PLEG): container finished" podID="a3818366-9e48-44ca-bc07-93c1f6feb484" containerID="fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45" exitCode=0 Jun 11 14:39:06.685261 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.685263 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" event={"ID":"a3818366-9e48-44ca-bc07-93c1f6feb484","Type":"ContainerDied","Data":"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45"} Jun 11 14:39:06.685487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.685268 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" Jun 11 14:39:06.685487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.685313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7" event={"ID":"a3818366-9e48-44ca-bc07-93c1f6feb484","Type":"ContainerDied","Data":"b2141fb60582b57c88967d058ff11d9e41caa8748986b9a259c84f563f29a149"} Jun 11 14:39:06.685487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.685338 2566 scope.go:117] "RemoveContainer" containerID="fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45" Jun 11 14:39:06.695267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.695248 2566 scope.go:117] "RemoveContainer" containerID="fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45" Jun 11 14:39:06.695530 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:39:06.695507 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45\": container with ID starting with fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45 not found: ID does not exist" containerID="fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45" Jun 11 14:39:06.695629 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.695536 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45"} err="failed to get container status \"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45\": rpc error: code = NotFound desc = could not find container \"fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45\": container with ID starting with fa8d8bc8e238de2d3a50f1f853640d7bb3806e2b8082540a1d1da027cdd1ed45 not found: ID does not exist" Jun 11 14:39:06.719339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.719315 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:39:06.728213 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:06.728191 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2m2t7"] Jun 11 14:39:08.085892 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:08.085861 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" path="/var/lib/kubelet/pods/a3818366-9e48-44ca-bc07-93c1f6feb484/volumes" Jun 11 14:39:22.526490 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.526443 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl"] Jun 11 14:39:22.527069 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.526729 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" containerName="manager" Jun 11 14:39:22.527069 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.526745 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" containerName="manager" Jun 11 14:39:22.527069 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.526842 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3818366-9e48-44ca-bc07-93c1f6feb484" containerName="manager" Jun 11 14:39:22.531028 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.531010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.534667 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.534646 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jk8h5\"" Jun 11 14:39:22.545853 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.545832 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl"] Jun 11 14:39:22.577023 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.576997 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:22.607700 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9319d-e8e9-4040-ab58-433811731550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.607822 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607706 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.607822 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.607822 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.607959 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.607959 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.608061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.607971 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.608061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.608015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9319d-e8e9-4040-ab58-433811731550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.608061 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.608047 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86j78\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-kube-api-access-86j78\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712112 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9319d-e8e9-4040-ab58-433811731550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712311 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712311 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712145 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712420 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712420 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712525 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712459 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712525 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712657 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9319d-e8e9-4040-ab58-433811731550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712657 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712657 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86j78\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-kube-api-access-86j78\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712934 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712884 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.712934 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712903 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.713146 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.712935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.713353 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.713329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc9319d-e8e9-4040-ab58-433811731550-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.715063 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.715043 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc9319d-e8e9-4040-ab58-433811731550-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.715146 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.715045 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc9319d-e8e9-4040-ab58-433811731550-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.721576 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.721542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.722088 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.722069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86j78\" (UniqueName: \"kubernetes.io/projected/1cc9319d-e8e9-4040-ab58-433811731550-kube-api-access-86j78\") pod \"maas-default-gateway-openshift-default-687ff6996-h66bl\" (UID: \"1cc9319d-e8e9-4040-ab58-433811731550\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.840411 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.840334 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:22.890605 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.890569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:22.989433 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:39:22.989398 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc9319d_e8e9_4040_ab58_433811731550.slice/crio-6640715ae3c3cc200e80f11126f06b53cd18b9e433b81c9a25ff05edc65b261b WatchSource:0}: Error finding container 6640715ae3c3cc200e80f11126f06b53cd18b9e433b81c9a25ff05edc65b261b: Status 404 returned error can't find the container with id 6640715ae3c3cc200e80f11126f06b53cd18b9e433b81c9a25ff05edc65b261b Jun 11 14:39:22.993962 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:22.993937 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl"] Jun 11 14:39:23.766677 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:23.766641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" event={"ID":"1cc9319d-e8e9-4040-ab58-433811731550","Type":"ContainerStarted","Data":"6640715ae3c3cc200e80f11126f06b53cd18b9e433b81c9a25ff05edc65b261b"} Jun 11 14:39:25.729124 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:25.729086 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:39:25.729366 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:25.729159 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:39:25.729366 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:25.729190 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:39:26.783395 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:26.783354 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" event={"ID":"1cc9319d-e8e9-4040-ab58-433811731550","Type":"ContainerStarted","Data":"e4204478efaf791a5c8cd45f32b4116d332779d142fbd6e0d78d6219eaf58e34"} Jun 11 14:39:26.809261 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:26.809217 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" podStartSLOduration=2.072465921 podStartE2EDuration="4.809199803s" totalImagesPullingTime="2.736733882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:39:26.80712054 +0000 UTC m=+701.233113219" watchObservedRunningTime="2026-06-11 14:39:26.809199803 +0000 UTC m=+701.235192534" Jun 11 14:39:26.841006 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:26.840971 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:26.845903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:26.845879 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:27.788367 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.788343 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:27.789417 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.789401 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:39:27.899273 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.899243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:27.905949 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.905923 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:27.909137 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.909120 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:27.911709 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.911692 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xt662\"" Jun 11 14:39:27.911793 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.911774 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 14:39:27.911793 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.911777 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:39:27.912112 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.912083 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:39:27.922727 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.922707 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:27.960254 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.960221 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kfzw\" (UniqueName: \"kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:27.960428 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.960289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:27.996941 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.996839 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:27.998436 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:27.998415 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:28.060758 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.060679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:28.060758 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.060742 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kfzw\" (UniqueName: \"kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:28.061408 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.061385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:28.072210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.072191 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kfzw\" (UniqueName: \"kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw\") pod \"limitador-limitador-64c94fd64f-5mjr9\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:28.112295 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.112259 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:28.219339 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.219308 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:28.362005 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.361942 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:28.364118 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:39:28.364090 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0d8947_3507_4afb_9734_41dcccadda75.slice/crio-cb11c1bfd262a6f4dbb268eb89139b188a472349ce9e5af35ea90f78285dbf18 WatchSource:0}: Error finding container cb11c1bfd262a6f4dbb268eb89139b188a472349ce9e5af35ea90f78285dbf18: Status 404 returned error can't find the container with id cb11c1bfd262a6f4dbb268eb89139b188a472349ce9e5af35ea90f78285dbf18 Jun 11 14:39:28.794865 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.794835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" event={"ID":"2e0d8947-3507-4afb-9734-41dcccadda75","Type":"ContainerStarted","Data":"cb11c1bfd262a6f4dbb268eb89139b188a472349ce9e5af35ea90f78285dbf18"} Jun 11 14:39:28.917638 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:28.917608 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:29.128905 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:29.128755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:31.813121 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:31.813085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" event={"ID":"2e0d8947-3507-4afb-9734-41dcccadda75","Type":"ContainerStarted","Data":"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127"} Jun 11 14:39:31.813487 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:31.813165 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:31.837280 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:31.837234 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" podStartSLOduration=2.129781848 podStartE2EDuration="4.837220397s" totalImagesPullingTime="2.707438549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:39:31.834735662 +0000 UTC m=+706.260728350" watchObservedRunningTime="2026-06-11 14:39:31.837220397 +0000 UTC m=+706.263213072" Jun 11 14:39:42.819517 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:42.819484 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:45.517983 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:45.517947 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:45.518388 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:45.518128 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" podUID="2e0d8947-3507-4afb-9734-41dcccadda75" containerName="limitador" containerID="cri-o://01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127" gracePeriod=30 Jun 11 14:39:46.065475 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.065452 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:46.205575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.205498 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kfzw\" (UniqueName: \"kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw\") pod \"2e0d8947-3507-4afb-9734-41dcccadda75\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " Jun 11 14:39:46.205575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.205539 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file\") pod \"2e0d8947-3507-4afb-9734-41dcccadda75\" (UID: \"2e0d8947-3507-4afb-9734-41dcccadda75\") " Jun 11 14:39:46.205936 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.205911 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file" (OuterVolumeSpecName: "config-file") pod "2e0d8947-3507-4afb-9734-41dcccadda75" (UID: "2e0d8947-3507-4afb-9734-41dcccadda75"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:39:46.207974 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.207942 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw" (OuterVolumeSpecName: "kube-api-access-2kfzw") pod "2e0d8947-3507-4afb-9734-41dcccadda75" (UID: "2e0d8947-3507-4afb-9734-41dcccadda75"). InnerVolumeSpecName "kube-api-access-2kfzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:39:46.306106 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.306079 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kfzw\" (UniqueName: \"kubernetes.io/projected/2e0d8947-3507-4afb-9734-41dcccadda75-kube-api-access-2kfzw\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:39:46.306106 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.306103 2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2e0d8947-3507-4afb-9734-41dcccadda75-config-file\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:39:46.888267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.888237 2566 generic.go:356] "Generic (PLEG): container finished" podID="2e0d8947-3507-4afb-9734-41dcccadda75" containerID="01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127" exitCode=0 Jun 11 14:39:46.888663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.888288 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" Jun 11 14:39:46.888663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.888288 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" event={"ID":"2e0d8947-3507-4afb-9734-41dcccadda75","Type":"ContainerDied","Data":"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127"} Jun 11 14:39:46.888663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.888398 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5mjr9" event={"ID":"2e0d8947-3507-4afb-9734-41dcccadda75","Type":"ContainerDied","Data":"cb11c1bfd262a6f4dbb268eb89139b188a472349ce9e5af35ea90f78285dbf18"} Jun 11 14:39:46.888663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.888424 2566 scope.go:117] "RemoveContainer" containerID="01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127" Jun 11 14:39:46.897784 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.897762 2566 scope.go:117] "RemoveContainer" containerID="01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127" Jun 11 14:39:46.898064 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:39:46.898036 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127\": container with ID starting with 01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127 not found: ID does not exist" containerID="01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127" Jun 11 14:39:46.898143 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.898077 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127"} err="failed to get container status \"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127\": rpc error: code = NotFound desc = could not find container \"01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127\": container with ID starting with 01f5a8e646d07d3b8423bd6fc608ce2a1765270ece640cb6b76c5a7600f08127 not found: ID does not exist" Jun 11 14:39:46.933068 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.933037 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:46.947008 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:46.946984 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5mjr9"] Jun 11 14:39:48.088958 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:48.086621 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e0d8947-3507-4afb-9734-41dcccadda75" path="/var/lib/kubelet/pods/2e0d8947-3507-4afb-9734-41dcccadda75/volumes" Jun 11 14:39:49.100677 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.100644 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-2qv2b"] Jun 11 14:39:49.101101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.101078 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e0d8947-3507-4afb-9734-41dcccadda75" containerName="limitador" Jun 11 14:39:49.101101 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.101095 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e0d8947-3507-4afb-9734-41dcccadda75" containerName="limitador" Jun 11 14:39:49.101213 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.101201 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e0d8947-3507-4afb-9734-41dcccadda75" containerName="limitador" Jun 11 14:39:49.105575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.105556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.109868 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.109851 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 14:39:49.118878 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.118853 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2qv2b"] Jun 11 14:39:49.149522 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.149495 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:49.230567 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.230532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c42w\" (UniqueName: \"kubernetes.io/projected/2a30a247-db66-4433-85d3-143383d4ce6a-kube-api-access-4c42w\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.230725 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.230632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a30a247-db66-4433-85d3-143383d4ce6a-data\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.331511 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.331479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c42w\" (UniqueName: \"kubernetes.io/projected/2a30a247-db66-4433-85d3-143383d4ce6a-kube-api-access-4c42w\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.331641 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.331542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a30a247-db66-4433-85d3-143383d4ce6a-data\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.331890 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.331875 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2a30a247-db66-4433-85d3-143383d4ce6a-data\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.341718 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.341694 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c42w\" (UniqueName: \"kubernetes.io/projected/2a30a247-db66-4433-85d3-143383d4ce6a-kube-api-access-4c42w\") pod \"postgres-69fb4594cf-2qv2b\" (UID: \"2a30a247-db66-4433-85d3-143383d4ce6a\") " pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.414612 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.414554 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:49.555786 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.555760 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2qv2b"] Jun 11 14:39:49.557219 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:39:49.557191 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a30a247_db66_4433_85d3_143383d4ce6a.slice/crio-8362f43d25c861dcfbca7202655ab5d4e64c2ef973567b4923316ee4d931b305 WatchSource:0}: Error finding container 8362f43d25c861dcfbca7202655ab5d4e64c2ef973567b4923316ee4d931b305: Status 404 returned error can't find the container with id 8362f43d25c861dcfbca7202655ab5d4e64c2ef973567b4923316ee4d931b305 Jun 11 14:39:49.904503 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:49.904467 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2qv2b" event={"ID":"2a30a247-db66-4433-85d3-143383d4ce6a","Type":"ContainerStarted","Data":"8362f43d25c861dcfbca7202655ab5d4e64c2ef973567b4923316ee4d931b305"} Jun 11 14:39:52.921903 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:52.921870 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2qv2b" event={"ID":"2a30a247-db66-4433-85d3-143383d4ce6a","Type":"ContainerStarted","Data":"7a21b01e974cf1cb85ecbd01120d05aea150729f34df09174955403d857e7bac"} Jun 11 14:39:52.922284 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:52.921996 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:52.939573 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:52.939518 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-2qv2b" podStartSLOduration=1.050791353 podStartE2EDuration="3.939503696s" totalImagesPullingTime="2.888712343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:39:52.939332139 +0000 UTC m=+727.365324815" watchObservedRunningTime="2026-06-11 14:39:52.939503696 +0000 UTC m=+727.365496372" Jun 11 14:39:58.956739 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:58.956710 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-2qv2b" Jun 11 14:39:59.379768 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:59.379733 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:59.514208 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:59.514176 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:39:59.698432 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:39:59.698342 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:40:00.007190 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:00.007152 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:40:01.817023 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.816986 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n"] Jun 11 14:40:01.820210 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.820195 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:01.824846 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.824823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 14:40:01.825641 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.825619 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 14:40:01.838648 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.838613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-p8pbk\"" Jun 11 14:40:01.846503 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.846472 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n"] Jun 11 14:40:01.934136 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.934103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:01.934297 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.934150 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:01.934297 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:01.934174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks9bv\" (UniqueName: \"kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.034568 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.034537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.034760 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.034575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks9bv\" (UniqueName: \"kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.034760 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.034623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.034972 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.034952 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.035035 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.034977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.050654 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.050625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks9bv\" (UniqueName: \"kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.129500 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.129413 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:02.277419 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:40:02.277391 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f71403_4d7d_42a0_99b8_297b1808c141.slice/crio-4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e WatchSource:0}: Error finding container 4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e: Status 404 returned error can't find the container with id 4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e Jun 11 14:40:02.278471 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.278441 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n"] Jun 11 14:40:02.974145 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.974112 2566 generic.go:356] "Generic (PLEG): container finished" podID="04f71403-4d7d-42a0-99b8-297b1808c141" containerID="00e0b061a268c46d2e8f9c9a710e21c7be41a8ec1730cd47d3f8af210ede8ea5" exitCode=0 Jun 11 14:40:02.974512 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.974207 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" event={"ID":"04f71403-4d7d-42a0-99b8-297b1808c141","Type":"ContainerDied","Data":"00e0b061a268c46d2e8f9c9a710e21c7be41a8ec1730cd47d3f8af210ede8ea5"} Jun 11 14:40:02.974512 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:02.974256 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" event={"ID":"04f71403-4d7d-42a0-99b8-297b1808c141","Type":"ContainerStarted","Data":"4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e"} Jun 11 14:40:03.980632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:03.980544 2566 generic.go:356] "Generic (PLEG): container finished" podID="04f71403-4d7d-42a0-99b8-297b1808c141" containerID="7e5597ed248fc4a0005d70afe3a2c7599a61854a89f924475d3722e70379cd8a" exitCode=0 Jun 11 14:40:03.980632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:03.980600 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" event={"ID":"04f71403-4d7d-42a0-99b8-297b1808c141","Type":"ContainerDied","Data":"7e5597ed248fc4a0005d70afe3a2c7599a61854a89f924475d3722e70379cd8a"} Jun 11 14:40:04.987652 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:04.987615 2566 generic.go:356] "Generic (PLEG): container finished" podID="04f71403-4d7d-42a0-99b8-297b1808c141" containerID="60dae5f8c74796f2c46c6a403ca09dd88e821bb6c2c07c8c3b2d9ce957feb116" exitCode=0 Jun 11 14:40:04.988143 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:04.987699 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" event={"ID":"04f71403-4d7d-42a0-99b8-297b1808c141","Type":"ContainerDied","Data":"60dae5f8c74796f2c46c6a403ca09dd88e821bb6c2c07c8c3b2d9ce957feb116"} Jun 11 14:40:06.126730 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.126709 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:06.270721 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.270698 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle\") pod \"04f71403-4d7d-42a0-99b8-297b1808c141\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " Jun 11 14:40:06.270887 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.270730 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks9bv\" (UniqueName: \"kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv\") pod \"04f71403-4d7d-42a0-99b8-297b1808c141\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " Jun 11 14:40:06.270887 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.270761 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util\") pod \"04f71403-4d7d-42a0-99b8-297b1808c141\" (UID: \"04f71403-4d7d-42a0-99b8-297b1808c141\") " Jun 11 14:40:06.271226 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.271191 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle" (OuterVolumeSpecName: "bundle") pod "04f71403-4d7d-42a0-99b8-297b1808c141" (UID: "04f71403-4d7d-42a0-99b8-297b1808c141"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:40:06.273309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.273283 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv" (OuterVolumeSpecName: "kube-api-access-ks9bv") pod "04f71403-4d7d-42a0-99b8-297b1808c141" (UID: "04f71403-4d7d-42a0-99b8-297b1808c141"). InnerVolumeSpecName "kube-api-access-ks9bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:40:06.277267 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.277243 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util" (OuterVolumeSpecName: "util") pod "04f71403-4d7d-42a0-99b8-297b1808c141" (UID: "04f71403-4d7d-42a0-99b8-297b1808c141"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:40:06.371416 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.371387 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-bundle\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:40:06.371416 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.371413 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks9bv\" (UniqueName: \"kubernetes.io/projected/04f71403-4d7d-42a0-99b8-297b1808c141-kube-api-access-ks9bv\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:40:06.371416 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.371423 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04f71403-4d7d-42a0-99b8-297b1808c141-util\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:40:06.999811 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.999782 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" Jun 11 14:40:06.999987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.999827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748c5t5n" event={"ID":"04f71403-4d7d-42a0-99b8-297b1808c141","Type":"ContainerDied","Data":"4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e"} Jun 11 14:40:06.999987 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:06.999866 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4448f1a9dc69530ee2fed71ea4c2961378d035626273770900bf13fe73b3d21e" Jun 11 14:40:12.568828 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.568777 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2xr46"] Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569104 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="util" Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569115 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="util" Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569131 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="pull" Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569136 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="pull" Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569149 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="extract" Jun 11 14:40:12.569199 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569154 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="extract" Jun 11 14:40:12.569403 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.569206 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f71403-4d7d-42a0-99b8-297b1808c141" containerName="extract" Jun 11 14:40:12.572398 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.572383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" Jun 11 14:40:12.576890 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.576862 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:40:12.577028 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.576931 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-568bn\"" Jun 11 14:40:12.577479 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.577462 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:40:12.601911 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.601887 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2xr46"] Jun 11 14:40:12.724151 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.724114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvd24\" (UniqueName: \"kubernetes.io/projected/c22abab2-3346-4dbc-89dd-a3d83dd287c1-kube-api-access-lvd24\") pod \"keycloak-operator-d67dbbb48-2xr46\" (UID: \"c22abab2-3346-4dbc-89dd-a3d83dd287c1\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" Jun 11 14:40:12.824703 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.824616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvd24\" (UniqueName: \"kubernetes.io/projected/c22abab2-3346-4dbc-89dd-a3d83dd287c1-kube-api-access-lvd24\") pod \"keycloak-operator-d67dbbb48-2xr46\" (UID: \"c22abab2-3346-4dbc-89dd-a3d83dd287c1\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" Jun 11 14:40:12.843214 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.843185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvd24\" (UniqueName: \"kubernetes.io/projected/c22abab2-3346-4dbc-89dd-a3d83dd287c1-kube-api-access-lvd24\") pod \"keycloak-operator-d67dbbb48-2xr46\" (UID: \"c22abab2-3346-4dbc-89dd-a3d83dd287c1\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" Jun 11 14:40:12.882974 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:12.882944 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" Jun 11 14:40:13.056368 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:13.056337 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2xr46"] Jun 11 14:40:13.059427 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:40:13.059398 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22abab2_3346_4dbc_89dd_a3d83dd287c1.slice/crio-51b1390879e91bc06306c323a0cfc9a632a10b0cceb5d23c1662eac642b2c449 WatchSource:0}: Error finding container 51b1390879e91bc06306c323a0cfc9a632a10b0cceb5d23c1662eac642b2c449: Status 404 returned error can't find the container with id 51b1390879e91bc06306c323a0cfc9a632a10b0cceb5d23c1662eac642b2c449 Jun 11 14:40:14.039515 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:14.039476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" event={"ID":"c22abab2-3346-4dbc-89dd-a3d83dd287c1","Type":"ContainerStarted","Data":"51b1390879e91bc06306c323a0cfc9a632a10b0cceb5d23c1662eac642b2c449"} Jun 11 14:40:20.078038 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:20.078001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" event={"ID":"c22abab2-3346-4dbc-89dd-a3d83dd287c1","Type":"ContainerStarted","Data":"e76693d468057fbcefdd21653f1503d0897c65854b57a1c354139c8c5025ba10"} Jun 11 14:40:20.103924 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:20.103867 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-2xr46" podStartSLOduration=1.8271314589999998 podStartE2EDuration="8.1038512s" totalImagesPullingTime="6.276719741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:40:20.102509693 +0000 UTC m=+754.528502368" watchObservedRunningTime="2026-06-11 14:40:20.1038512 +0000 UTC m=+754.529843876" Jun 11 14:40:28.295647 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:28.295607 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:40:28.398325 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:28.398277 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:40:59.881299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:40:59.881205 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:00.057094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:00.057034 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:00.558919 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:00.558882 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:00.680939 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:00.680904 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:06.359884 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.359855 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:06.466692 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.466657 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:06.572206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.572169 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:06.622592 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.622511 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:41:06.625681 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.625663 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.628769 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.628748 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 14:41:06.629632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.629610 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rl4fw\"" Jun 11 14:41:06.629725 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.629675 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 14:41:06.648699 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.648679 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:41:06.757356 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.757316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.757540 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.757376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbwkq\" (UniqueName: \"kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.858602 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.858567 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.858837 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.858615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbwkq\" (UniqueName: \"kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.861228 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.861202 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.868673 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.868649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbwkq\" (UniqueName: \"kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq\") pod \"maas-controller-786bff9cb-mqk7q\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:06.935902 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:06.935848 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:07.087821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:07.087780 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:41:07.091383 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:41:07.091355 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf491ebdb_e3df_46ab_aa33_864c176154e0.slice/crio-309f9f523e2f0188b8e8916c69121e5b704811c9d4d12405580567b4d04ff912 WatchSource:0}: Error finding container 309f9f523e2f0188b8e8916c69121e5b704811c9d4d12405580567b4d04ff912: Status 404 returned error can't find the container with id 309f9f523e2f0188b8e8916c69121e5b704811c9d4d12405580567b4d04ff912 Jun 11 14:41:07.092912 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:07.092891 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:41:07.307844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:07.307814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-mqk7q" event={"ID":"f491ebdb-e3df-46ab-aa33-864c176154e0","Type":"ContainerStarted","Data":"309f9f523e2f0188b8e8916c69121e5b704811c9d4d12405580567b4d04ff912"} Jun 11 14:41:09.713545 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:09.713456 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:09.907300 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:09.907244 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:10.326586 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:10.326551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-mqk7q" event={"ID":"f491ebdb-e3df-46ab-aa33-864c176154e0","Type":"ContainerStarted","Data":"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d"} Jun 11 14:41:10.326794 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:10.326682 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:10.373027 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:10.372974 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-786bff9cb-mqk7q" podStartSLOduration=2.017113234 podStartE2EDuration="4.372958402s" totalImagesPullingTime="2.355845168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:10.371567182 +0000 UTC m=+804.797559857" watchObservedRunningTime="2026-06-11 14:41:10.372958402 +0000 UTC m=+804.798951119" Jun 11 14:41:21.337641 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:21.337609 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:41:40.728305 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:40.728264 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:41.048948 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:41.048916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:41.794884 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:41.794852 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:42.028107 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.028067 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:41:42.291311 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.291277 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tzjkj"] Jun 11 14:41:42.299067 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.299041 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tzjkj"] Jun 11 14:41:42.299249 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.299200 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:42.304277 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.304256 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 14:41:42.304575 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.304552 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r5rpn\"" Jun 11 14:41:42.357735 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.357697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4jz\" (UniqueName: \"kubernetes.io/projected/d160e19e-056d-4165-b772-667587c6366e-kube-api-access-ph4jz\") pod \"payload-pre-processing-579785bc64-tzjkj\" (UID: \"d160e19e-056d-4165-b772-667587c6366e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:42.459094 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.459056 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4jz\" (UniqueName: \"kubernetes.io/projected/d160e19e-056d-4165-b772-667587c6366e-kube-api-access-ph4jz\") pod \"payload-pre-processing-579785bc64-tzjkj\" (UID: \"d160e19e-056d-4165-b772-667587c6366e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:42.489069 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.489029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4jz\" (UniqueName: \"kubernetes.io/projected/d160e19e-056d-4165-b772-667587c6366e-kube-api-access-ph4jz\") pod \"payload-pre-processing-579785bc64-tzjkj\" (UID: \"d160e19e-056d-4165-b772-667587c6366e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:42.608959 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.608867 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:42.821458 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:42.821430 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-tzjkj"] Jun 11 14:41:42.824218 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:41:42.824191 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd160e19e_056d_4165_b772_667587c6366e.slice/crio-643e79fb8d35cc4c09d4ebd4079c52e53c719bafb9d0b373fd87375279117be5 WatchSource:0}: Error finding container 643e79fb8d35cc4c09d4ebd4079c52e53c719bafb9d0b373fd87375279117be5: Status 404 returned error can't find the container with id 643e79fb8d35cc4c09d4ebd4079c52e53c719bafb9d0b373fd87375279117be5 Jun 11 14:41:43.501018 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:43.500976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" event={"ID":"d160e19e-056d-4165-b772-667587c6366e","Type":"ContainerStarted","Data":"643e79fb8d35cc4c09d4ebd4079c52e53c719bafb9d0b373fd87375279117be5"} Jun 11 14:41:46.532600 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:46.532553 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" event={"ID":"d160e19e-056d-4165-b772-667587c6366e","Type":"ContainerStarted","Data":"a9b7946c8774d0edf1f4c12df034f6926d3ca6890e43a948c8aabc517b70f111"} Jun 11 14:41:46.533500 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:46.533472 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:41:46.568309 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:46.568251 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" podStartSLOduration=1.8371891439999999 podStartE2EDuration="4.568235979s" totalImagesPullingTime="2.731046835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:46.567629487 +0000 UTC m=+840.993622163" watchObservedRunningTime="2026-06-11 14:41:46.568235979 +0000 UTC m=+840.994228687" Jun 11 14:41:50.557396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.557364 2566 generic.go:356] "Generic (PLEG): container finished" podID="1cc9319d-e8e9-4040-ab58-433811731550" containerID="e4204478efaf791a5c8cd45f32b4116d332779d142fbd6e0d78d6219eaf58e34" exitCode=0 Jun 11 14:41:50.557396 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.557406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" event={"ID":"1cc9319d-e8e9-4040-ab58-433811731550","Type":"ContainerDied","Data":"e4204478efaf791a5c8cd45f32b4116d332779d142fbd6e0d78d6219eaf58e34"} Jun 11 14:41:50.557898 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.557778 2566 scope.go:117] "RemoveContainer" containerID="e4204478efaf791a5c8cd45f32b4116d332779d142fbd6e0d78d6219eaf58e34" Jun 11 14:41:50.558768 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.558736 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:41:50.558872 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.558854 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:41:50.558915 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:50.558897 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 14:41:51.564392 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:51.564359 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" event={"ID":"1cc9319d-e8e9-4040-ab58-433811731550","Type":"ContainerStarted","Data":"d76a378886f057245ae8f9a594d716af8d5635b6bc81f890bdc8f1ecf06f8640"} Jun 11 14:41:51.841576 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:51.841466 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:41:51.841576 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:51.841530 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h66bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 11 14:41:51.841869 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:51.841611 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" podUID="1cc9319d-e8e9-4040-ab58-433811731550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 11 14:41:52.841562 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:52.841521 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h66bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 11 14:41:52.842216 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:52.842182 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" podUID="1cc9319d-e8e9-4040-ab58-433811731550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 11 14:41:53.841279 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:53.841236 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h66bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 11 14:41:53.841591 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:53.841558 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" podUID="1cc9319d-e8e9-4040-ab58-433811731550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 11 14:41:54.842153 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:54.841688 2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-h66bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jun 11 14:41:54.842153 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:54.841753 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" podUID="1cc9319d-e8e9-4040-ab58-433811731550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jun 11 14:41:55.845765 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:55.845736 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:41:55.846229 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:55.846040 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:41:55.846717 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:55.846699 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-h66bl" Jun 11 14:41:58.546198 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:41:58.546173 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-tzjkj" Jun 11 14:42:16.437943 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:42:16.437896 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:42:17.834169 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:42:17.834132 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:42:46.086839 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:42:46.086749 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:42:46.087930 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:42:46.087910 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:43:52.379434 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:43:52.379400 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:44:50.764422 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:44:50.764373 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:44:50.866568 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:44:50.866535 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:44:53.760372 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:44:53.760337 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:44:53.841292 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:44:53.841257 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:00.141252 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.141215 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686485-zw4rt"] Jun 11 14:45:00.144551 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.144534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:00.147200 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.147179 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rbnx2\"" Jun 11 14:45:00.159118 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.159094 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686485-zw4rt"] Jun 11 14:45:00.161203 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.161176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qvp\" (UniqueName: \"kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp\") pod \"maas-api-key-cleanup-29686485-zw4rt\" (UID: \"3c1f5759-862f-4a68-b918-42834fad3d46\") " pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:00.262209 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.262177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qvp\" (UniqueName: \"kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp\") pod \"maas-api-key-cleanup-29686485-zw4rt\" (UID: \"3c1f5759-862f-4a68-b918-42834fad3d46\") " pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:00.271646 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.271626 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qvp\" (UniqueName: \"kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp\") pod \"maas-api-key-cleanup-29686485-zw4rt\" (UID: \"3c1f5759-862f-4a68-b918-42834fad3d46\") " pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:00.453865 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.453768 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:00.596856 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:00.596831 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686485-zw4rt"] Jun 11 14:45:00.598360 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:45:00.598327 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1f5759_862f_4a68_b918_42834fad3d46.slice/crio-d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a WatchSource:0}: Error finding container d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a: Status 404 returned error can't find the container with id d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a Jun 11 14:45:01.535719 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:01.535681 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" event={"ID":"3c1f5759-862f-4a68-b918-42834fad3d46","Type":"ContainerStarted","Data":"d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a"} Jun 11 14:45:02.654143 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:02.654102 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:03.547692 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:03.547660 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" event={"ID":"3c1f5759-862f-4a68-b918-42834fad3d46","Type":"ContainerStarted","Data":"c40e2d51a1161ce93d218a51df6d88ff00cd2494f9024959ffd6c132a6e36dc0"} Jun 11 14:45:03.567366 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:03.567316 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" podStartSLOduration=1.340265848 podStartE2EDuration="3.567301035s" totalImagesPullingTime="2.227035187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:45:03.565541291 +0000 UTC m=+1037.991533969" watchObservedRunningTime="2026-06-11 14:45:03.567301035 +0000 UTC m=+1037.993293711" Jun 11 14:45:04.554883 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:04.554846 2566 generic.go:356] "Generic (PLEG): container finished" podID="3c1f5759-862f-4a68-b918-42834fad3d46" containerID="c40e2d51a1161ce93d218a51df6d88ff00cd2494f9024959ffd6c132a6e36dc0" exitCode=0 Jun 11 14:45:04.555270 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:04.554901 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" event={"ID":"3c1f5759-862f-4a68-b918-42834fad3d46","Type":"ContainerDied","Data":"c40e2d51a1161ce93d218a51df6d88ff00cd2494f9024959ffd6c132a6e36dc0"} Jun 11 14:45:05.159260 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.159219 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:05.217579 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.217540 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:05.690452 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.690427 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:05.711249 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.711222 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5qvp\" (UniqueName: \"kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp\") pod \"3c1f5759-862f-4a68-b918-42834fad3d46\" (UID: \"3c1f5759-862f-4a68-b918-42834fad3d46\") " Jun 11 14:45:05.713913 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.713884 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp" (OuterVolumeSpecName: "kube-api-access-q5qvp") pod "3c1f5759-862f-4a68-b918-42834fad3d46" (UID: "3c1f5759-862f-4a68-b918-42834fad3d46"). InnerVolumeSpecName "kube-api-access-q5qvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:45:05.812564 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:05.812487 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5qvp\" (UniqueName: \"kubernetes.io/projected/3c1f5759-862f-4a68-b918-42834fad3d46-kube-api-access-q5qvp\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:45:06.565784 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:06.565758 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" Jun 11 14:45:06.565976 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:06.565757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686485-zw4rt" event={"ID":"3c1f5759-862f-4a68-b918-42834fad3d46","Type":"ContainerDied","Data":"d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a"} Jun 11 14:45:06.565976 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:06.565891 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d57e0d9daa6fcbde1eb742a10069a51abe38601cdd5a8f8638bb02512b24c77a" Jun 11 14:45:09.279969 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.279936 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf"] Jun 11 14:45:09.280435 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.280393 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1f5759-862f-4a68-b918-42834fad3d46" containerName="cleanup" Jun 11 14:45:09.280435 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.280412 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1f5759-862f-4a68-b918-42834fad3d46" containerName="cleanup" Jun 11 14:45:09.280558 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.280505 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1f5759-862f-4a68-b918-42834fad3d46" containerName="cleanup" Jun 11 14:45:09.283647 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.283626 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.287051 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.287030 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 14:45:09.287186 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.287052 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cr49b\"" Jun 11 14:45:09.288035 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.288016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 14:45:09.288136 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.288068 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 14:45:09.294821 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.294783 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf"] Jun 11 14:45:09.342545 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scp92\" (UniqueName: \"kubernetes.io/projected/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kube-api-access-scp92\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.342708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.342708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a63ce543-6d1c-4b19-995d-ca59d4981a4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.342708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.342871 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342712 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.342871 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.342734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.437961 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.437929 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:09.444016 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.443988 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444141 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444141 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444069 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scp92\" (UniqueName: \"kubernetes.io/projected/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kube-api-access-scp92\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444141 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a63ce543-6d1c-4b19-995d-ca59d4981a4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444272 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444449 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444521 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444491 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.444567 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.444513 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.446648 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.446617 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a63ce543-6d1c-4b19-995d-ca59d4981a4f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.446815 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.446782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a63ce543-6d1c-4b19-995d-ca59d4981a4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.453355 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.453334 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scp92\" (UniqueName: \"kubernetes.io/projected/a63ce543-6d1c-4b19-995d-ca59d4981a4f-kube-api-access-scp92\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-7vlhf\" (UID: \"a63ce543-6d1c-4b19-995d-ca59d4981a4f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.594579 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.594489 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:09.734597 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:09.734532 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf"] Jun 11 14:45:09.736716 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:45:09.736691 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63ce543_6d1c_4b19_995d_ca59d4981a4f.slice/crio-b63bca47a1ab6fbbd8511ee8a26fc19fa9d2bf66d306120f54791f390c37caca WatchSource:0}: Error finding container b63bca47a1ab6fbbd8511ee8a26fc19fa9d2bf66d306120f54791f390c37caca: Status 404 returned error can't find the container with id b63bca47a1ab6fbbd8511ee8a26fc19fa9d2bf66d306120f54791f390c37caca Jun 11 14:45:10.588278 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:10.588239 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" event={"ID":"a63ce543-6d1c-4b19-995d-ca59d4981a4f","Type":"ContainerStarted","Data":"b63bca47a1ab6fbbd8511ee8a26fc19fa9d2bf66d306120f54791f390c37caca"} Jun 11 14:45:13.614497 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:13.614456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" event={"ID":"a63ce543-6d1c-4b19-995d-ca59d4981a4f","Type":"ContainerStarted","Data":"b8f9bf488c068f3e979f4ca8ffb8346000e62188b253c9610287b14ed17aa387"} Jun 11 14:45:14.621542 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:14.621506 2566 generic.go:356] "Generic (PLEG): container finished" podID="a63ce543-6d1c-4b19-995d-ca59d4981a4f" containerID="b8f9bf488c068f3e979f4ca8ffb8346000e62188b253c9610287b14ed17aa387" exitCode=0 Jun 11 14:45:14.621983 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:14.621589 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" event={"ID":"a63ce543-6d1c-4b19-995d-ca59d4981a4f","Type":"ContainerDied","Data":"b8f9bf488c068f3e979f4ca8ffb8346000e62188b253c9610287b14ed17aa387"} Jun 11 14:45:16.136133 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:16.136048 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:16.636526 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:16.636494 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" event={"ID":"a63ce543-6d1c-4b19-995d-ca59d4981a4f","Type":"ContainerStarted","Data":"e7a4f534e0917fc5b2cad149fd73ef155eda255edd919782f645d280dc5f4b31"} Jun 11 14:45:16.674047 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:16.673996 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" podStartSLOduration=2.17868355 podStartE2EDuration="7.673981195s" totalImagesPullingTime="4.190734207s" totalInitContainerRuntime="1.304563438s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:45:16.67257586 +0000 UTC m=+1051.098568537" watchObservedRunningTime="2026-06-11 14:45:16.673981195 +0000 UTC m=+1051.099973871" Jun 11 14:45:19.595540 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:19.595502 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:19.596023 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:19.595585 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:19.607874 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:19.607848 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:19.663826 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:19.663778 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-7vlhf" Jun 11 14:45:31.953882 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:31.953781 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8"] Jun 11 14:45:31.970185 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:31.970152 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:31.982175 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:31.982153 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 14:45:32.032792 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.032759 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8"] Jun 11 14:45:32.033092 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.033139 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/503356af-2f33-4b7a-b2d5-40cb1ace01f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.033173 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.033206 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.033245 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.033285 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.033252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm2h8\" (UniqueName: \"kubernetes.io/projected/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kube-api-access-pm2h8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.073289 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.073245 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:32.134479 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134447 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.134642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134493 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/503356af-2f33-4b7a-b2d5-40cb1ace01f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.134642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.134642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.134642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.134642 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm2h8\" (UniqueName: \"kubernetes.io/projected/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kube-api-access-pm2h8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.135011 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134963 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.135011 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.134989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.135106 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.135038 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.137073 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.137036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/503356af-2f33-4b7a-b2d5-40cb1ace01f1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.137265 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.137246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/503356af-2f33-4b7a-b2d5-40cb1ace01f1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.157241 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.157220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm2h8\" (UniqueName: \"kubernetes.io/projected/503356af-2f33-4b7a-b2d5-40cb1ace01f1-kube-api-access-pm2h8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8\" (UID: \"503356af-2f33-4b7a-b2d5-40cb1ace01f1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.281358 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.281326 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:45:32.468367 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.468346 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8"] Jun 11 14:45:32.470491 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:45:32.470459 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503356af_2f33_4b7a_b2d5_40cb1ace01f1.slice/crio-ff836eb4dd5120dffd1303c518adf08d087d52dbd1182d2e5ec6aafed5d2677c WatchSource:0}: Error finding container ff836eb4dd5120dffd1303c518adf08d087d52dbd1182d2e5ec6aafed5d2677c: Status 404 returned error can't find the container with id ff836eb4dd5120dffd1303c518adf08d087d52dbd1182d2e5ec6aafed5d2677c Jun 11 14:45:32.719252 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.719214 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" event={"ID":"503356af-2f33-4b7a-b2d5-40cb1ace01f1","Type":"ContainerStarted","Data":"b929135b93cf69d5cdee205a843bfd05bce6163fe942dc29fef51382d5d9a98c"} Jun 11 14:45:32.719418 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:32.719286 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" event={"ID":"503356af-2f33-4b7a-b2d5-40cb1ace01f1","Type":"ContainerStarted","Data":"ff836eb4dd5120dffd1303c518adf08d087d52dbd1182d2e5ec6aafed5d2677c"} Jun 11 14:45:40.225102 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:40.225059 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:43.894655 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:43.894624 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:45:51.961185 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:45:51.961145 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:46:26.013578 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:26.013544 2566 generic.go:356] "Generic (PLEG): container finished" podID="503356af-2f33-4b7a-b2d5-40cb1ace01f1" containerID="b929135b93cf69d5cdee205a843bfd05bce6163fe942dc29fef51382d5d9a98c" exitCode=0 Jun 11 14:46:26.014008 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:26.013617 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" event={"ID":"503356af-2f33-4b7a-b2d5-40cb1ace01f1","Type":"ContainerDied","Data":"b929135b93cf69d5cdee205a843bfd05bce6163fe942dc29fef51382d5d9a98c"} Jun 11 14:46:26.014226 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:26.014211 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:46:27.021453 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:27.021421 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" event={"ID":"503356af-2f33-4b7a-b2d5-40cb1ace01f1","Type":"ContainerStarted","Data":"ce4d12db1e85a7b8377ea6976096507b4dc9ae23460d101f3e3e8074856bf8a2"} Jun 11 14:46:27.047548 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:27.047495 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" podStartSLOduration=2.493453336 podStartE2EDuration="56.047467729s" totalImagesPullingTime="326.437848ms" totalInitContainerRuntime="53.227576545s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:46:27.045462498 +0000 UTC m=+1121.471455197" watchObservedRunningTime="2026-06-11 14:46:27.047467729 +0000 UTC m=+1121.473460408" Jun 11 14:46:32.281682 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:32.281644 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:46:32.282109 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:32.281704 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:46:32.294439 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:32.294416 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:46:33.064635 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:33.064596 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8" Jun 11 14:46:52.794922 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:52.794885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:46:53.031915 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:53.031876 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:46:54.796602 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:54.796549 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:46:54.910276 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:46:54.910246 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:47:46.132016 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:47:46.131985 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:47:46.132852 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:47:46.132832 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:47:59.983812 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:47:59.983763 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:48:53.368995 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.368961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:48:53.455220 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.455184 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:48:53.455460 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.455438 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-786bff9cb-mqk7q" podUID="f491ebdb-e3df-46ab-aa33-864c176154e0" containerName="manager" containerID="cri-o://23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d" gracePeriod=30 Jun 11 14:48:53.705708 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.705680 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:48:53.769632 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.769603 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert\") pod \"f491ebdb-e3df-46ab-aa33-864c176154e0\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " Jun 11 14:48:53.769844 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.769751 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbwkq\" (UniqueName: \"kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq\") pod \"f491ebdb-e3df-46ab-aa33-864c176154e0\" (UID: \"f491ebdb-e3df-46ab-aa33-864c176154e0\") " Jun 11 14:48:53.771992 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.771956 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq" (OuterVolumeSpecName: "kube-api-access-tbwkq") pod "f491ebdb-e3df-46ab-aa33-864c176154e0" (UID: "f491ebdb-e3df-46ab-aa33-864c176154e0"). InnerVolumeSpecName "kube-api-access-tbwkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:48:53.772127 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.772071 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f491ebdb-e3df-46ab-aa33-864c176154e0" (UID: "f491ebdb-e3df-46ab-aa33-864c176154e0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:48:53.801158 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.801129 2566 generic.go:356] "Generic (PLEG): container finished" podID="f491ebdb-e3df-46ab-aa33-864c176154e0" containerID="23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d" exitCode=0 Jun 11 14:48:53.801299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.801176 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-mqk7q" Jun 11 14:48:53.801299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.801193 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-mqk7q" event={"ID":"f491ebdb-e3df-46ab-aa33-864c176154e0","Type":"ContainerDied","Data":"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d"} Jun 11 14:48:53.801299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.801233 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-mqk7q" event={"ID":"f491ebdb-e3df-46ab-aa33-864c176154e0","Type":"ContainerDied","Data":"309f9f523e2f0188b8e8916c69121e5b704811c9d4d12405580567b4d04ff912"} Jun 11 14:48:53.801299 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.801254 2566 scope.go:117] "RemoveContainer" containerID="23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d" Jun 11 14:48:53.810731 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.810714 2566 scope.go:117] "RemoveContainer" containerID="23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d" Jun 11 14:48:53.811040 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:48:53.811024 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d\": container with ID starting with 23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d not found: ID does not exist" containerID="23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d" Jun 11 14:48:53.811092 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.811049 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d"} err="failed to get container status \"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d\": rpc error: code = NotFound desc = could not find container \"23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d\": container with ID starting with 23b95c8d73b93645b304f3242742ec0bab214de59046cffafb9d1ca28194760d not found: ID does not exist" Jun 11 14:48:53.827506 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.827477 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:48:53.839173 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.839143 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-786bff9cb-mqk7q"] Jun 11 14:48:53.871022 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.870986 2566 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f491ebdb-e3df-46ab-aa33-864c176154e0-webhook-cert\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:48:53.871022 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:53.871014 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbwkq\" (UniqueName: \"kubernetes.io/projected/f491ebdb-e3df-46ab-aa33-864c176154e0-kube-api-access-tbwkq\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 14:48:54.086654 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.086622 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f491ebdb-e3df-46ab-aa33-864c176154e0" path="/var/lib/kubelet/pods/f491ebdb-e3df-46ab-aa33-864c176154e0/volumes" Jun 11 14:48:54.682214 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.682158 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:48:54.770489 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.770452 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-786bff9cb-gpvkd"] Jun 11 14:48:54.770795 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.770783 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f491ebdb-e3df-46ab-aa33-864c176154e0" containerName="manager" Jun 11 14:48:54.770855 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.770797 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f491ebdb-e3df-46ab-aa33-864c176154e0" containerName="manager" Jun 11 14:48:54.770890 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.770864 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f491ebdb-e3df-46ab-aa33-864c176154e0" containerName="manager" Jun 11 14:48:54.775095 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.775079 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:54.783460 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.783437 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 14:48:54.783581 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.783483 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 14:48:54.783581 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.783483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rl4fw\"" Jun 11 14:48:54.800724 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.800684 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786bff9cb-gpvkd"] Jun 11 14:48:54.880317 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.880277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2fe6aad-3f29-4374-9be3-e59a95082190-webhook-cert\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:54.880519 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.880342 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf6rp\" (UniqueName: \"kubernetes.io/projected/c2fe6aad-3f29-4374-9be3-e59a95082190-kube-api-access-mf6rp\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:54.981374 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.981288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf6rp\" (UniqueName: \"kubernetes.io/projected/c2fe6aad-3f29-4374-9be3-e59a95082190-kube-api-access-mf6rp\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:54.981374 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.981347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2fe6aad-3f29-4374-9be3-e59a95082190-webhook-cert\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:54.983937 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:54.983908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2fe6aad-3f29-4374-9be3-e59a95082190-webhook-cert\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:55.001667 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:55.001642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf6rp\" (UniqueName: \"kubernetes.io/projected/c2fe6aad-3f29-4374-9be3-e59a95082190-kube-api-access-mf6rp\") pod \"maas-controller-786bff9cb-gpvkd\" (UID: \"c2fe6aad-3f29-4374-9be3-e59a95082190\") " pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:55.084864 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:55.084821 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:55.242159 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:55.242131 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-786bff9cb-gpvkd"] Jun 11 14:48:55.244469 ip-10-0-128-209 kubenswrapper[2566]: W0611 14:48:55.244445 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fe6aad_3f29_4374_9be3_e59a95082190.slice/crio-f84e494a7543f5f72acd4127092f45eda7cd73d23b99e20783b412d387df7a1b WatchSource:0}: Error finding container f84e494a7543f5f72acd4127092f45eda7cd73d23b99e20783b412d387df7a1b: Status 404 returned error can't find the container with id f84e494a7543f5f72acd4127092f45eda7cd73d23b99e20783b412d387df7a1b Jun 11 14:48:55.814977 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:55.814947 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-gpvkd" event={"ID":"c2fe6aad-3f29-4374-9be3-e59a95082190","Type":"ContainerStarted","Data":"f84e494a7543f5f72acd4127092f45eda7cd73d23b99e20783b412d387df7a1b"} Jun 11 14:48:56.821581 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:56.821546 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-786bff9cb-gpvkd" event={"ID":"c2fe6aad-3f29-4374-9be3-e59a95082190","Type":"ContainerStarted","Data":"7ef6a5796072688003ec4af0a4a15238c48ba0b2a7c1975f2079dc18ba4a036f"} Jun 11 14:48:56.822095 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:56.821664 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:48:56.875219 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:48:56.875168 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-786bff9cb-gpvkd" podStartSLOduration=2.337958589 podStartE2EDuration="2.875152113s" totalImagesPullingTime="537.193524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:48:56.867011037 +0000 UTC m=+1271.293003712" watchObservedRunningTime="2026-06-11 14:48:56.875152113 +0000 UTC m=+1271.301144788" Jun 11 14:49:07.846893 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:07.846864 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-786bff9cb-gpvkd" Jun 11 14:49:40.370354 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:40.370311 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:49:40.552050 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:40.552013 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:49:49.037308 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:49.037275 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:49:55.203371 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:55.203333 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:49:55.338672 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:49:55.338633 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:27.526663 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:27.526625 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:27.628089 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:27.628052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:51.604175 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:51.604125 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:58.121529 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:58.121492 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:58.267361 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:58.267327 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:58.370268 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:58.370238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:58.534191 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:58.534150 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:50:58.635435 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:50:58.635399 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:16.274058 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:16.274018 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:16.378361 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:16.378316 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:20.498217 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:20.498186 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:21.711656 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:21.711619 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:21.890627 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:21.890596 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:29.907148 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:29.907006 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:30.016274 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:30.016228 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:30.128390 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:30.128350 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:30.224947 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:30.224847 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:39.196870 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:39.196839 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:46.889490 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:46.889442 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:47.517140 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:47.517099 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:54.637410 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:54.637368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:51:54.789364 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:51:54.789333 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:01.500705 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:01.500652 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:08.828602 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:08.828554 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-786bff9cb-gpvkd" podUID="c2fe6aad-3f29-4374-9be3-e59a95082190" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.43:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 14:52:16.474182 ip-10-0-128-209 kubenswrapper[2566]: E0611 14:52:16.474141 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-06-11T14:52:06Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-06-11T14:52:06Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-06-11T14:52:06Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-06-11T14:52:06Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"}]}}\" for node \"ip-10-0-128-209.ec2.internal\": Patch \"https://a394bde3fb98a43aa9eed18113679d65-fd07ef6d81c13e4f.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-128-209.ec2.internal/status?timeout=10s\": context deadline exceeded" Jun 11 14:52:20.971213 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:20.971179 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:21.591462 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:21.591421 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:23.467817 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:23.467755 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:23.645737 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:23.645699 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:23.800215 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:23.800183 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:26.835729 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:26.835689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:31.109922 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:31.109883 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:31.301427 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:31.301386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:31.523342 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:31.523303 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:31.853881 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:31.853767 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:38.373165 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:38.373134 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:38.544144 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:38.544103 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:52:46.166761 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:46.166727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:52:46.170857 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:52:46.170829 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:57:23.198694 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:57:23.198655 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:57:31.318172 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:57:31.318092 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:57:31.383290 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:57:31.383251 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:57:46.207443 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:57:46.207404 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:57:46.211929 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:57:46.211898 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 14:59:58.699509 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:59:58.699468 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 14:59:58.766898 ip-10-0-128-209 kubenswrapper[2566]: I0611 14:59:58.766866 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:02:46.244993 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:02:46.244890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 15:02:46.254664 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:02:46.254640 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 15:04:38.511729 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:04:38.511694 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:14.727648 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:06:14.727614 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:36.536464 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:06:36.536381 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:06:36.609982 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:06:36.609942 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:07:46.282691 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:07:46.282665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 15:07:46.291590 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:07:46.291572 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tnknt_adcd6aac-75b1-4996-b209-1d2d2f68cac9/ovn-acl-logging/0.log" Jun 11 15:09:47.318027 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.317996 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:09:47.321510 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.321487 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.341198 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.341175 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ba122869-openshift-default-dockercfg-llth4\"" Jun 11 15:09:47.418086 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418238 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418238 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418238 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418143 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418238 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418216 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418376 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418376 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418320 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8wr\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418376 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.418469 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.418397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519235 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519319 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519349 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519448 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519862 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519862 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8wr\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519862 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519658 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.519862 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519706 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.520064 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.519980 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.520192 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.520169 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.525463 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.520935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.525463 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.523285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.525463 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.523474 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.556395 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.556322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8wr\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.563281 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.563254 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token\") pod \"e2e-ait-ba122869-openshift-default-545697d88-h8bv7\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.599919 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.599858 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:09:47.631696 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.631636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:47.667674 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.667638 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:47.803333 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.803307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:09:47.805815 ip-10-0-128-209 kubenswrapper[2566]: W0611 15:09:47.805780 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777ef076_9887_4f66_a8b8_8e0ce8fe4935.slice/crio-e48fdce36f254048d02ef46898ad3f494685da12f60eb4a399eb8af9d5c4852f WatchSource:0}: Error finding container e48fdce36f254048d02ef46898ad3f494685da12f60eb4a399eb8af9d5c4852f: Status 404 returned error can't find the container with id e48fdce36f254048d02ef46898ad3f494685da12f60eb4a399eb8af9d5c4852f Jun 11 15:09:47.807792 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.807757 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:09:47.807924 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.807860 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:09:47.807924 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:47.807905 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:09:48.461092 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:48.461058 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" event={"ID":"777ef076-9887-4f66-a8b8-8e0ce8fe4935","Type":"ContainerStarted","Data":"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1"} Jun 11 15:09:48.461561 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:48.461105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" event={"ID":"777ef076-9887-4f66-a8b8-8e0ce8fe4935","Type":"ContainerStarted","Data":"e48fdce36f254048d02ef46898ad3f494685da12f60eb4a399eb8af9d5c4852f"} Jun 11 15:09:48.632760 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:48.632725 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:48.637454 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:48.637422 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:48.689451 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:48.689393 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" podStartSLOduration=1.689372365 podStartE2EDuration="1.689372365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:09:48.503672289 +0000 UTC m=+2522.929664964" watchObservedRunningTime="2026-06-11 15:09:48.689372365 +0000 UTC m=+2523.115365041" Jun 11 15:09:49.000546 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:49.000505 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:49.466443 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:49.466413 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:49.467370 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:49.467352 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:51.408218 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:51.408182 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:54.014291 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:54.014248 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:54.228207 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:54.228173 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:09:54.228403 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:54.228378 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" podUID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" containerName="istio-proxy" containerID="cri-o://a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1" gracePeriod=30 Jun 11 15:09:54.257456 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:54.257423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:54.424009 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:54.423916 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:56.057563 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:56.057530 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:09:59.487315 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.487262 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:59.523716 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.523682 2566 generic.go:356] "Generic (PLEG): container finished" podID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" containerID="a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1" exitCode=0 Jun 11 15:09:59.523884 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.523733 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" Jun 11 15:09:59.523884 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.523754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" event={"ID":"777ef076-9887-4f66-a8b8-8e0ce8fe4935","Type":"ContainerDied","Data":"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1"} Jun 11 15:09:59.523884 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.523867 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7" event={"ID":"777ef076-9887-4f66-a8b8-8e0ce8fe4935","Type":"ContainerDied","Data":"e48fdce36f254048d02ef46898ad3f494685da12f60eb4a399eb8af9d5c4852f"} Jun 11 15:09:59.524062 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.523902 2566 scope.go:117] "RemoveContainer" containerID="a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1" Jun 11 15:09:59.534638 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.534624 2566 scope.go:117] "RemoveContainer" containerID="a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1" Jun 11 15:09:59.534957 ip-10-0-128-209 kubenswrapper[2566]: E0611 15:09:59.534940 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1\": container with ID starting with a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1 not found: ID does not exist" containerID="a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1" Jun 11 15:09:59.535026 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.534966 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1"} err="failed to get container status \"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1\": rpc error: code = NotFound desc = could not find container \"a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1\": container with ID starting with a8d505deb8946ffdd09be71e7a7edebc7572fdb3933cba5080a4d6b8ef06d7b1 not found: ID does not exist" Jun 11 15:09:59.624824 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.624779 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.624983 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.624853 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.624983 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.624889 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.624983 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.624910 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.624983 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.624946 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.625202 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625081 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.625202 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625151 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:59.625311 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625222 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.625311 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625245 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.625311 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:59.625311 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625260 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data" (OuterVolumeSpecName: "istio-data") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:59.625509 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625323 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq8wr\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr\") pod \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\" (UID: \"777ef076-9887-4f66-a8b8-8e0ce8fe4935\") " Jun 11 15:09:59.625509 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625321 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:09:59.625509 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625438 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:59.625763 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625744 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-certs\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.625843 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625769 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istiod-ca-cert\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.625843 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625783 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-workload-socket\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.625843 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625795 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-data\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.625843 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.625840 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-credential-socket\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.627300 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.627274 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:09:59.627300 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.627279 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 15:09:59.627876 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.627857 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token" (OuterVolumeSpecName: "istio-token") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:09:59.627876 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.627866 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr" (OuterVolumeSpecName: "kube-api-access-jq8wr") pod "777ef076-9887-4f66-a8b8-8e0ce8fe4935" (UID: "777ef076-9887-4f66-a8b8-8e0ce8fe4935"). InnerVolumeSpecName "kube-api-access-jq8wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:09:59.726413 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.726386 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-token\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.726413 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.726411 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq8wr\" (UniqueName: \"kubernetes.io/projected/777ef076-9887-4f66-a8b8-8e0ce8fe4935-kube-api-access-jq8wr\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.726554 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.726424 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-envoy\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.726554 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.726436 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/777ef076-9887-4f66-a8b8-8e0ce8fe4935-istio-podinfo\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:09:59.846546 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.846520 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:09:59.850841 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:09:59.850818 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ba122869-openshift-default-545697d88-h8bv7"] Jun 11 15:10:00.087206 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:00.087113 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" path="/var/lib/kubelet/pods/777ef076-9887-4f66-a8b8-8e0ce8fe4935/volumes" Jun 11 15:10:01.015553 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.015518 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:01.135585 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.135550 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:01.254323 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.254279 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:01.254744 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.254724 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" containerName="istio-proxy" Jun 11 15:10:01.254866 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.254745 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" containerName="istio-proxy" Jun 11 15:10:01.254921 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.254880 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="777ef076-9887-4f66-a8b8-8e0ce8fe4935" containerName="istio-proxy" Jun 11 15:10:01.259256 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.259233 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.264031 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.264005 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-beae70f6-openshift-default-dockercfg-gq2fv\"" Jun 11 15:10:01.294786 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.294751 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:01.316139 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.316105 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:01.339518 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339518 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gl82\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.339762 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.340032 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.339769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.436063 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.436029 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:01.441162 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441308 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441308 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441439 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gl82\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441439 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441381 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441439 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441439 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441424 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441653 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441653 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441653 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441653 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441635 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441916 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.441977 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.441923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.442184 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.442166 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.443871 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.443850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.444163 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.444146 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.468522 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.468489 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gl82\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.469602 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.469576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token\") pod \"e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.571694 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.571605 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:01.619446 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.619414 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:01.737643 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.737599 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:01.740862 ip-10-0-128-209 kubenswrapper[2566]: W0611 15:10:01.740837 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1ede51_6601_4894_903a_57eb3f4e1891.slice/crio-ddac19b9e228cf3946f491345a13fe2f03efaa2d3ea7f1703283acb5b4ec9f99 WatchSource:0}: Error finding container ddac19b9e228cf3946f491345a13fe2f03efaa2d3ea7f1703283acb5b4ec9f99: Status 404 returned error can't find the container with id ddac19b9e228cf3946f491345a13fe2f03efaa2d3ea7f1703283acb5b4ec9f99 Jun 11 15:10:01.743120 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.743080 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:10:01.743208 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.743164 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:10:01.743208 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.743204 2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 15:10:01.744341 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:01.744314 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:02.542866 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:02.542827 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" event={"ID":"ba1ede51-6601-4894-903a-57eb3f4e1891","Type":"ContainerStarted","Data":"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721"} Jun 11 15:10:02.543271 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:02.542915 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" event={"ID":"ba1ede51-6601-4894-903a-57eb3f4e1891","Type":"ContainerStarted","Data":"ddac19b9e228cf3946f491345a13fe2f03efaa2d3ea7f1703283acb5b4ec9f99"} Jun 11 15:10:02.572466 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:02.572430 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:02.577368 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:02.577342 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:02.582883 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:02.582838 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" podStartSLOduration=1.582823307 podStartE2EDuration="1.582823307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:10:02.580881396 +0000 UTC m=+2537.006874074" watchObservedRunningTime="2026-06-11 15:10:02.582823307 +0000 UTC m=+2537.008815980" Jun 11 15:10:03.548422 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:03.548391 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:03.549508 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:03.549488 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:04.505651 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:04.505609 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:08.167922 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:08.167885 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:09.799813 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:09.799766 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:09.800185 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:09.799986 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" podUID="ba1ede51-6601-4894-903a-57eb3f4e1891" containerName="istio-proxy" containerID="cri-o://6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721" gracePeriod=30 Jun 11 15:10:09.832746 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:09.832714 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:09.954901 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:09.954863 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:11.605545 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:11.605514 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:12.950199 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:12.950162 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:15.054534 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.054508 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:15.167059 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.166986 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167059 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167015 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167059 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167050 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167072 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167126 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167170 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gl82\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167205 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167244 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167301 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167281 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token\") pod \"ba1ede51-6601-4894-903a-57eb3f4e1891\" (UID: \"ba1ede51-6601-4894-903a-57eb3f4e1891\") " Jun 11 15:10:15.167600 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167311 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:10:15.167600 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167433 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:10:15.167600 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167511 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:10:15.167722 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167619 2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-socket\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.167722 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167640 2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1ede51-6601-4894-903a-57eb3f4e1891-istiod-ca-cert\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.167722 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167652 2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-credential-socket\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.167877 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167757 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:10:15.167877 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.167768 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:10:15.169629 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.169598 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82" (OuterVolumeSpecName: "kube-api-access-8gl82") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "kube-api-access-8gl82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:10:15.169740 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.169630 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:10:15.169740 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.169714 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:10:15.169740 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.169711 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba1ede51-6601-4894-903a-57eb3f4e1891" (UID: "ba1ede51-6601-4894-903a-57eb3f4e1891"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 11 15:10:15.268721 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268686 2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-envoy\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.268721 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268711 2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-token\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.268721 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268721 2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-data\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.268971 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268731 2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1ede51-6601-4894-903a-57eb3f4e1891-workload-certs\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.268971 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268739 2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1ede51-6601-4894-903a-57eb3f4e1891-istio-podinfo\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.268971 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.268748 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gl82\" (UniqueName: \"kubernetes.io/projected/ba1ede51-6601-4894-903a-57eb3f4e1891-kube-api-access-8gl82\") on node \"ip-10-0-128-209.ec2.internal\" DevicePath \"\"" Jun 11 15:10:15.612246 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.612213 2566 generic.go:356] "Generic (PLEG): container finished" podID="ba1ede51-6601-4894-903a-57eb3f4e1891" containerID="6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721" exitCode=0 Jun 11 15:10:15.612442 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.612264 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" Jun 11 15:10:15.612442 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.612277 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" event={"ID":"ba1ede51-6601-4894-903a-57eb3f4e1891","Type":"ContainerDied","Data":"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721"} Jun 11 15:10:15.612442 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.612320 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8" event={"ID":"ba1ede51-6601-4894-903a-57eb3f4e1891","Type":"ContainerDied","Data":"ddac19b9e228cf3946f491345a13fe2f03efaa2d3ea7f1703283acb5b4ec9f99"} Jun 11 15:10:15.612442 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.612340 2566 scope.go:117] "RemoveContainer" containerID="6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721" Jun 11 15:10:15.622090 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.622070 2566 scope.go:117] "RemoveContainer" containerID="6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721" Jun 11 15:10:15.622351 ip-10-0-128-209 kubenswrapper[2566]: E0611 15:10:15.622332 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721\": container with ID starting with 6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721 not found: ID does not exist" containerID="6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721" Jun 11 15:10:15.622400 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.622361 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721"} err="failed to get container status \"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721\": rpc error: code = NotFound desc = could not find container \"6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721\": container with ID starting with 6d25fedc0909885f66cf15d1d6435530659437bd481e5f930e400fb13773e721 not found: ID does not exist" Jun 11 15:10:15.635760 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.635727 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:15.640095 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:15.640071 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-beae70f6-openshift-default-5df9877df4-5v2g8"] Jun 11 15:10:16.087509 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:16.087473 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1ede51-6601-4894-903a-57eb3f4e1891" path="/var/lib/kubelet/pods/ba1ede51-6601-4894-903a-57eb3f4e1891/volumes" Jun 11 15:10:16.441366 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:16.441279 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:16.519718 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:16.519682 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:29.831725 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:29.831686 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67cd5f7d45-q75cb_65ed0706-3496-4d35-b571-7ec63020f799/nginx/0.log" Jun 11 15:10:30.022528 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:30.022483 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-9k4q8_b4edde0d-3114-4b3f-ab1f-d41ac10308e4/manager/0.log" Jun 11 15:10:30.206830 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:30.206723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-xzgkj_05694f94-1d92-4b68-bb8f-84445636f3cf/manager/0.log" Jun 11 15:10:30.564899 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:30.564870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686485-zw4rt_3c1f5759-862f-4a68-b918-42834fad3d46/cleanup/0.log" Jun 11 15:10:30.933874 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:30.933770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-786bff9cb-gpvkd_c2fe6aad-3f29-4374-9be3-e59a95082190/manager/0.log" Jun 11 15:10:31.103221 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:31.103192 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-x2f2t_b00eaaad-2f53-4ea7-9bdc-57de805190ae/server/0.log" Jun 11 15:10:31.647600 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:31.647569 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-z6kpr_e03d1f39-b8db-48b0-9733-291d91e9e46f/copy-manifests/0.log" Jun 11 15:10:31.657677 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:31.657646 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-z6kpr_e03d1f39-b8db-48b0-9733-291d91e9e46f/manager/0.log" Jun 11 15:10:32.049330 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:32.049292 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2qv2b_2a30a247-db66-4433-85d3-143383d4ce6a/postgres/0.log" Jun 11 15:10:33.333481 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.333450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/util/0.log" Jun 11 15:10:33.340542 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.340514 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/pull/0.log" Jun 11 15:10:33.348509 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.348486 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/extract/0.log" Jun 11 15:10:33.602218 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.602133 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/util/0.log" Jun 11 15:10:33.608873 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.608848 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/pull/0.log" Jun 11 15:10:33.615127 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.615109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/extract/0.log" Jun 11 15:10:33.805920 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.805890 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/util/0.log" Jun 11 15:10:33.813981 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.813957 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/pull/0.log" Jun 11 15:10:33.820131 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.820115 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/extract/0.log" Jun 11 15:10:33.996494 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:33.996414 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/util/0.log" Jun 11 15:10:34.003569 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:34.003545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/pull/0.log" Jun 11 15:10:34.009927 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:34.009904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/extract/0.log" Jun 11 15:10:36.305320 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:36.305279 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5jn94_c58f83b7-5111-476c-a239-dfc2938e0c30/discovery/0.log" Jun 11 15:10:36.655008 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:36.654920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cd6686fb-wvrrn_35a7d403-924c-496a-95a5-cde6be12cd22/kube-auth-proxy/0.log" Jun 11 15:10:36.853216 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:36.853178 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/1.log" Jun 11 15:10:37.056971 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:37.056937 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tzjkj_d160e19e-056d-4165-b772-667587c6366e/payload-pre-processing/0.log" Jun 11 15:10:38.175666 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:38.175637 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7vlhf_a63ce543-6d1c-4b19-995d-ca59d4981a4f/storage-initializer/0.log" Jun 11 15:10:38.185610 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:38.185578 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-7vlhf_a63ce543-6d1c-4b19-995d-ca59d4981a4f/main/0.log" Jun 11 15:10:38.565225 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:38.565188 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8_503356af-2f33-4b7a-b2d5-40cb1ace01f1/storage-initializer/0.log" Jun 11 15:10:38.579702 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:38.579680 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clr2n8_503356af-2f33-4b7a-b2d5-40cb1ace01f1/main/0.log" Jun 11 15:10:46.420586 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:46.420531 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:46.520683 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:46.520650 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" limit=1024 Jun 11 15:10:49.522026 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:49.521993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5zqmn_38d7435d-7499-4de0-8862-b2909e6902be/global-pull-secret-syncer/0.log" Jun 11 15:10:49.776183 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:49.776098 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j4j2h_67ed7a04-1864-4798-9a59-a2cb2530f330/konnectivity-agent/0.log" Jun 11 15:10:49.946479 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:49.946434 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-209.ec2.internal_d9aea4a15849b0a3c4984de51c7c9186/haproxy/0.log" Jun 11 15:10:53.657283 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:53.657248 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-ds9qz_f1c4069e-f116-472c-84b5-7a7cc1734aa4/sail-operator/0.log" Jun 11 15:10:54.115087 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.115059 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/extract/0.log" Jun 11 15:10:54.136912 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.136882 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/util/0.log" Jun 11 15:10:54.158304 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.158282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g2ql_c72505c0-b749-4228-a9d2-0de9805665ed/pull/0.log" Jun 11 15:10:54.185321 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.185300 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/extract/0.log" Jun 11 15:10:54.208959 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.208935 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/util/0.log" Jun 11 15:10:54.230883 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.230859 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dkfjc_ee10793b-29ec-4c45-b6e5-5fea3c955bd4/pull/0.log" Jun 11 15:10:54.263041 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.263013 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/extract/0.log" Jun 11 15:10:54.287783 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.287756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/util/0.log" Jun 11 15:10:54.322385 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.322341 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qrzhk_9785f694-b0b4-4ce3-bafd-6f18fefdf75e/pull/0.log" Jun 11 15:10:54.350723 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.350703 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/extract/0.log" Jun 11 15:10:54.381305 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.381234 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/util/0.log" Jun 11 15:10:54.403601 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:54.403571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ltllg_6dad5376-ab1b-4eac-8a7d-8d2953dd3efc/pull/0.log" Jun 11 15:10:57.237781 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:57.237697 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/node-exporter/0.log" Jun 11 15:10:57.259376 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:57.259353 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/kube-rbac-proxy/0.log" Jun 11 15:10:57.299008 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:10:57.298982 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5w9gl_fcf98f86-36b8-4319-8756-e26763367f1d/init-textfile/0.log" Jun 11 15:11:00.692124 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.692039 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4"] Jun 11 15:11:00.692596 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.692378 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1ede51-6601-4894-903a-57eb3f4e1891" containerName="istio-proxy" Jun 11 15:11:00.692596 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.692390 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1ede51-6601-4894-903a-57eb3f4e1891" containerName="istio-proxy" Jun 11 15:11:00.692596 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.692470 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1ede51-6601-4894-903a-57eb3f4e1891" containerName="istio-proxy" Jun 11 15:11:00.696869 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.696851 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.699252 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.699232 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m5f7r\"/\"kube-root-ca.crt\"" Jun 11 15:11:00.699367 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.699312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m5f7r\"/\"default-dockercfg-hjcwt\"" Jun 11 15:11:00.700240 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.700226 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m5f7r\"/\"openshift-service-ca.crt\"" Jun 11 15:11:00.705077 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.705054 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4"] Jun 11 15:11:00.755034 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.755005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp97g\" (UniqueName: \"kubernetes.io/projected/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-kube-api-access-tp97g\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.755235 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.755058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-podres\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.755235 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.755107 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-sys\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.755235 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.755135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-proc\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.755235 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.755189 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-lib-modules\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856106 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-lib-modules\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp97g\" (UniqueName: \"kubernetes.io/projected/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-kube-api-access-tp97g\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-podres\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-sys\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-proc\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856240 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-lib-modules\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856261 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-proc\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-podres\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.856387 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.856314 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-sys\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:00.866090 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:00.866060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp97g\" (UniqueName: \"kubernetes.io/projected/4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb-kube-api-access-tp97g\") pod \"perf-node-gather-daemonset-jcxg4\" (UID: \"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:01.008177 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.008145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:01.148011 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.147986 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4"] Jun 11 15:11:01.150068 ip-10-0-128-209 kubenswrapper[2566]: W0611 15:11:01.150034 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4e299d5a_b412_41c7_a4e9_b2b29a2dc3cb.slice/crio-822403ce736d39f2971b0819eafb7b2dcb4534906eb8c620808dccdf059914fd WatchSource:0}: Error finding container 822403ce736d39f2971b0819eafb7b2dcb4534906eb8c620808dccdf059914fd: Status 404 returned error can't find the container with id 822403ce736d39f2971b0819eafb7b2dcb4534906eb8c620808dccdf059914fd Jun 11 15:11:01.860081 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.860040 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" event={"ID":"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb","Type":"ContainerStarted","Data":"7f4d32e67f19ee68ca299623b847de01862c139e3e5043cf085697f4eb3df786"} Jun 11 15:11:01.860486 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.860102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" event={"ID":"4e299d5a-b412-41c7-a4e9-b2b29a2dc3cb","Type":"ContainerStarted","Data":"822403ce736d39f2971b0819eafb7b2dcb4534906eb8c620808dccdf059914fd"} Jun 11 15:11:01.860486 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.860214 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:01.880605 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:01.880557 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" podStartSLOduration=1.8805416209999999 podStartE2EDuration="1.880541621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:01.879595012 +0000 UTC m=+2596.305587696" watchObservedRunningTime="2026-06-11 15:11:01.880541621 +0000 UTC m=+2596.306534297" Jun 11 15:11:02.642784 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:02.642747 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2md4m_70e89735-b15c-4a29-a301-118c61643dd7/dns/0.log" Jun 11 15:11:02.665040 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:02.665014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2md4m_70e89735-b15c-4a29-a301-118c61643dd7/kube-rbac-proxy/0.log" Jun 11 15:11:02.866052 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:02.866021 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qfmdc_6e9d9442-5174-40bf-99a0-c95249deef4f/dns-node-resolver/0.log" Jun 11 15:11:03.520400 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:03.520373 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzctx_c29cf67e-2170-471f-9fd2-0118b1a2c592/node-ca/0.log" Jun 11 15:11:04.733341 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:04.733310 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5jn94_c58f83b7-5111-476c-a239-dfc2938e0c30/discovery/0.log" Jun 11 15:11:04.789741 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:04.789710 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cd6686fb-wvrrn_35a7d403-924c-496a-95a5-cde6be12cd22/kube-auth-proxy/0.log" Jun 11 15:11:04.827347 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:04.827308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/0.log" Jun 11 15:11:04.886226 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:04.886196 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/1.log" Jun 11 15:11:04.921592 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:04.921570 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tzjkj_d160e19e-056d-4165-b772-667587c6366e/payload-pre-processing/0.log" Jun 11 15:11:05.731162 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:05.731131 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5z2bw_04f21d6a-eaea-445d-898a-b6e51b31a288/serve-healthcheck-canary/0.log" Jun 11 15:11:06.324463 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:06.324436 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxqwr_32328d03-ee80-44e4-97db-231ed4f5f197/kube-rbac-proxy/0.log" Jun 11 15:11:06.347629 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:06.347593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxqwr_32328d03-ee80-44e4-97db-231ed4f5f197/exporter/0.log" Jun 11 15:11:06.369325 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:06.369303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxqwr_32328d03-ee80-44e4-97db-231ed4f5f197/extractor/0.log" Jun 11 15:11:07.876016 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:07.875990 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-jcxg4" Jun 11 15:11:09.000674 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.000642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67cd5f7d45-q75cb_65ed0706-3496-4d35-b571-7ec63020f799/nginx/0.log" Jun 11 15:11:09.035907 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.035873 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-9k4q8_b4edde0d-3114-4b3f-ab1f-d41ac10308e4/manager/0.log" Jun 11 15:11:09.151136 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.151102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-xzgkj_05694f94-1d92-4b68-bb8f-84445636f3cf/manager/0.log" Jun 11 15:11:09.241085 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.241054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686485-zw4rt_3c1f5759-862f-4a68-b918-42834fad3d46/cleanup/0.log" Jun 11 15:11:09.409537 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.409498 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-786bff9cb-gpvkd_c2fe6aad-3f29-4374-9be3-e59a95082190/manager/0.log" Jun 11 15:11:09.495754 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.495726 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-x2f2t_b00eaaad-2f53-4ea7-9bdc-57de805190ae/server/0.log" Jun 11 15:11:09.769269 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.769237 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-z6kpr_e03d1f39-b8db-48b0-9733-291d91e9e46f/manager/0.log" Jun 11 15:11:09.810449 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.810427 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-z6kpr_e03d1f39-b8db-48b0-9733-291d91e9e46f/copy-manifests/0.log" Jun 11 15:11:09.999395 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:09.999319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2qv2b_2a30a247-db66-4433-85d3-143383d4ce6a/postgres/0.log" Jun 11 15:11:14.004722 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:14.004688 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5jn94_c58f83b7-5111-476c-a239-dfc2938e0c30/discovery/0.log" Jun 11 15:11:14.105447 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:14.105412 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cd6686fb-wvrrn_35a7d403-924c-496a-95a5-cde6be12cd22/kube-auth-proxy/0.log" Jun 11 15:11:14.138315 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:14.138288 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/0.log" Jun 11 15:11:14.195999 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:14.195961 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/1.log" Jun 11 15:11:14.275517 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:14.275492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tzjkj_d160e19e-056d-4165-b772-667587c6366e/payload-pre-processing/0.log" Jun 11 15:11:15.604318 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:15.604291 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5jn94_c58f83b7-5111-476c-a239-dfc2938e0c30/discovery/0.log" Jun 11 15:11:15.672656 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:15.672625 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cd6686fb-wvrrn_35a7d403-924c-496a-95a5-cde6be12cd22/kube-auth-proxy/0.log" Jun 11 15:11:15.695441 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:15.695417 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/0.log" Jun 11 15:11:15.754836 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:15.754786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/1.log" Jun 11 15:11:15.791530 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:15.791507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tzjkj_d160e19e-056d-4165-b772-667587c6366e/payload-pre-processing/0.log" Jun 11 15:11:17.808733 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:17.808696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-5jn94_c58f83b7-5111-476c-a239-dfc2938e0c30/discovery/0.log" Jun 11 15:11:17.847267 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:17.847238 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cd6686fb-wvrrn_35a7d403-924c-496a-95a5-cde6be12cd22/kube-auth-proxy/0.log" Jun 11 15:11:17.876007 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:17.875981 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/0.log" Jun 11 15:11:17.936028 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:17.935990 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-h66bl_1cc9319d-e8e9-4040-ab58-433811731550/istio-proxy/1.log" Jun 11 15:11:17.963091 ip-10-0-128-209 kubenswrapper[2566]: I0611 15:11:17.963068 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-tzjkj_d160e19e-056d-4165-b772-667587c6366e/payload-pre-processing/0.log"