Jun 14 20:18:03.032426 ip-10-0-129-240 systemd[1]: Starting Kubernetes Kubelet... Jun 14 20:18:03.355240 ip-10-0-129-240 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:03.355240 ip-10-0-129-240 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 20:18:03.355240 ip-10-0-129-240 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:03.355240 ip-10-0-129-240 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 20:18:03.355240 ip-10-0-129-240 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 20:18:03.356019 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.355945 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 20:18:03.361105 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361091 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.361105 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361106 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361111 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361114 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361117 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361120 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361123 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361126 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361128 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361131 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361133 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361136 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361138 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361141 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361159 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361163 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361166 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361169 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361172 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361176 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.361195 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361178 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361181 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361184 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361186 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361189 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361193 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361196 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361203 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361206 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361209 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361212 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361215 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361217 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361220 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361223 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361225 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361228 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361231 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.361656 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361234 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361236 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361239 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361241 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361244 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361256 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361259 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361262 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361264 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361267 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361270 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361272 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361274 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361277 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361279 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361283 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361292 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361296 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361298 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361301 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.362161 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361304 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361306 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361309 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361311 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361314 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361317 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361319 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361322 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361324 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361327 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361329 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361332 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361335 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361337 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361340 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361342 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361345 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361347 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361350 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361353 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.362650 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361355 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361358 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361360 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361363 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361365 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361368 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361371 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361373 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361376 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361378 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361381 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361383 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361386 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361389 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361392 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361395 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361397 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361400 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361402 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.361405 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.363132 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362071 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362077 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362080 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362083 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362085 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362088 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362091 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362094 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362097 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362099 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362104 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362108 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362111 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362114 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362116 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362119 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362121 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362124 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362127 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362130 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.363639 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362132 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362135 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362137 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362140 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362158 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362161 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362165 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362169 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362173 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362175 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362178 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362181 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362184 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362186 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362189 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362193 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362196 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362202 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362206 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.364158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362209 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362212 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362215 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362217 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362220 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362222 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362225 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362227 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362230 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362232 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362235 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362238 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362241 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362243 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362246 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362248 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362251 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362253 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362256 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.364685 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362258 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362261 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362264 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362266 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362268 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362271 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362273 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362276 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362278 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362281 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362283 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362286 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362289 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362292 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362294 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362297 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362300 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362303 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362305 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.365165 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362308 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362310 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362313 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362315 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362319 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362322 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362325 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362327 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362330 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362332 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362335 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362337 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362340 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362343 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362345 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362348 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362351 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362353 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362357 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362360 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.365654 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362363 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362769 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362774 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362778 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362780 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362784 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362787 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362790 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362794 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362796 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362799 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362801 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362804 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362806 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362809 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362811 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362815 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362818 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362820 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362823 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.366137 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362825 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362828 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362830 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362833 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362837 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362840 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362843 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362846 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362849 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362852 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362854 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362857 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362860 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362862 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362865 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362867 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362870 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362873 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362876 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.366651 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362879 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362882 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362884 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362887 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362889 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362892 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362894 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362897 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362900 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362902 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362905 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362907 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362911 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362914 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362917 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362919 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362923 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362925 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362928 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362931 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.367112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362933 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362936 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362938 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362941 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362943 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362946 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362949 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362952 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362954 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362957 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362959 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362962 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362966 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362968 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362971 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362973 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362976 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362978 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362981 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362984 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.367614 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362987 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362989 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362991 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362994 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362996 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.362999 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363001 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363004 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363007 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363011 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363014 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363016 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363019 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363022 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363024 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363027 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363029 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363037 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363042 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363045 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.368090 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363048 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363111 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363117 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363123 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363128 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363134 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363139 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363158 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363165 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363168 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363172 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363175 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363178 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363181 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363184 2576 flags.go:64] FLAG: --cgroup-root="" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363187 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363189 2576 flags.go:64] FLAG: --client-ca-file="" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363192 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363195 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363199 2576 flags.go:64] FLAG: --cluster-domain="" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363201 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363204 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363207 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363211 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 20:18:03.368591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363214 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363217 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363220 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363223 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363226 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363229 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363234 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363237 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363239 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363243 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363247 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363250 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363253 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363256 2576 flags.go:64] FLAG: --enable-server="true" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363259 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363263 2576 flags.go:64] FLAG: --event-burst="100" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363267 2576 flags.go:64] FLAG: --event-qps="50" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363269 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363272 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363275 2576 flags.go:64] FLAG: --eviction-hard="" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363279 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363281 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363284 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363287 2576 flags.go:64] FLAG: --eviction-soft="" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363290 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 20:18:03.369281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363293 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363295 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363298 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363301 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363304 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363307 2576 flags.go:64] FLAG: --feature-gates="" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363310 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363313 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363316 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363318 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363321 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363324 2576 flags.go:64] FLAG: --help="false" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363327 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363332 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363334 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363337 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363340 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363344 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363346 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363349 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363352 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363355 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363358 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363361 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 20:18:03.369937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363364 2576 flags.go:64] FLAG: --kube-reserved="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363367 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363370 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363373 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363375 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363379 2576 flags.go:64] FLAG: --lock-file="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363381 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363384 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363387 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363392 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363395 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363397 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363400 2576 flags.go:64] FLAG: --logging-format="text" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363403 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363406 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363409 2576 flags.go:64] FLAG: --manifest-url="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363411 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363416 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363418 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363422 2576 flags.go:64] FLAG: --max-pods="110" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363425 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363430 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363433 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363436 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363439 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 20:18:03.370543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363442 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363444 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363451 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363454 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363457 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363460 2576 flags.go:64] FLAG: --pod-cidr="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363463 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363468 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363471 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363474 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363477 2576 flags.go:64] FLAG: --port="10250" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363480 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363483 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eed4f8f2f6db7989" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363486 2576 flags.go:64] FLAG: --qos-reserved="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363489 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363492 2576 flags.go:64] FLAG: --register-node="true" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363494 2576 flags.go:64] FLAG: --register-with-taints="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363498 2576 flags.go:64] FLAG: --registry-burst="10" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363500 2576 flags.go:64] FLAG: --registry-qps="5" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363503 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363506 2576 flags.go:64] FLAG: --reserved-memory="" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363509 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363512 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363515 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363518 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 20:18:03.371164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363520 2576 flags.go:64] FLAG: --runonce="false" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363523 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363526 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363529 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363533 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363535 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363538 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363541 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363544 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363547 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363550 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363552 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363555 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363558 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363561 2576 flags.go:64] FLAG: --system-cgroups="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363564 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363570 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363572 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363575 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363579 2576 flags.go:64] FLAG: --tls-min-version="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363581 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363584 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363587 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363590 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363593 2576 flags.go:64] FLAG: --v="2" Jun 14 20:18:03.371770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363597 2576 flags.go:64] FLAG: --version="false" Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363601 2576 flags.go:64] FLAG: --vmodule="" Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363604 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.363607 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363719 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363723 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363726 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363729 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363732 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363737 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363740 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363744 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363747 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363750 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363753 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363756 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363758 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363761 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363763 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363766 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.372389 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363768 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363772 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363777 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363779 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363782 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363785 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363787 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363790 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363792 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363795 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363797 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363800 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363802 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363805 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363807 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363810 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363812 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363815 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363817 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363820 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.372879 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363822 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363826 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363828 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363832 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363834 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363837 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363839 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363842 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363844 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363847 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363849 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363852 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363855 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363857 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363860 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363863 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363866 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363868 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363871 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363873 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.373395 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363876 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363878 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363881 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363884 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363886 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363889 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363891 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363894 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363896 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363900 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363904 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363907 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363910 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363914 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363917 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363920 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363924 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363926 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363929 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.373908 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363932 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363935 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363938 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363941 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363946 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363949 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363951 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363954 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363957 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363959 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363962 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363965 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363967 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363970 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363972 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363975 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363977 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363979 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363982 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.374394 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363986 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363989 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363992 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.363995 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.364627 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.371420 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.371435 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.371454 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.371459 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371523 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371530 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371533 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371536 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371539 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371542 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.374948 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371545 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371548 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371550 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371553 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371556 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371567 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371570 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371573 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371576 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371578 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371581 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371584 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371587 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371589 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371592 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371598 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371601 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371604 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.375345 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371606 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371609 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371611 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371614 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371618 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371621 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371623 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371626 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371628 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371631 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371634 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371636 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371639 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371641 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371644 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371647 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371649 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371651 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371654 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371657 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.375811 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371665 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371668 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371670 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371673 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371675 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371678 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371680 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371683 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371685 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371688 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371690 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371693 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371695 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371698 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371701 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371703 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371707 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371709 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371712 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.376383 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371714 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371718 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371722 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371725 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371727 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371730 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371733 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371735 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371738 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371740 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371743 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371745 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371748 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371750 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371758 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371761 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371764 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371766 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371769 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.376846 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371771 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371776 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371779 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371783 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371786 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371789 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371792 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371794 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371797 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371800 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371803 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371812 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371816 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371818 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371822 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.377334 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371825 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.371830 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371985 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371990 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371993 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371996 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.371998 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372001 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372004 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372006 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372009 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372011 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372014 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372022 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372025 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 20:18:03.377702 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372027 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372030 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372032 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372035 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372037 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372040 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372042 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372045 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372047 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372050 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372053 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372055 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372058 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372061 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372063 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372066 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372069 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372071 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372074 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372076 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 20:18:03.378087 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372079 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372081 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372084 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372086 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372089 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372091 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372094 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372096 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372098 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372101 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372105 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372114 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372117 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372120 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372122 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372125 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372128 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372131 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372135 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 20:18:03.378581 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372138 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372141 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372157 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372162 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372165 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372168 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372171 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372174 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372176 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372178 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372181 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372184 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372186 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372189 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372191 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372194 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372196 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372198 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372201 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372204 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 20:18:03.379037 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372206 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372209 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372211 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372213 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372216 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372225 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372227 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372230 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372232 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372235 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372237 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372239 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372242 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372244 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372247 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372250 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372253 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372255 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372258 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 20:18:03.379570 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372260 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372263 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372266 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372268 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372271 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372273 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372277 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:03.372280 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.372285 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.372389 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.374416 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.375618 2576 server.go:1019] "Starting client certificate rotation" Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.375721 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 20:18:03.380016 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.375775 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 20:18:03.380351 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.378018 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 20:18:03.381945 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.381929 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 20:18:03.393319 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.393299 2576 log.go:25] "Validated CRI v1 runtime API" Jun 14 20:18:03.396260 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.396243 2576 log.go:25] "Validated CRI v1 image API" Jun 14 20:18:03.397192 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.397176 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 20:18:03.401692 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.401670 2576 fs.go:135] Filesystem UUIDs: map[43c33db2-37b2-4d1f-9043-807a6e77d573:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 efc2bc81-7ca1-40be-81d8-f45ef4c2dbea:/dev/nvme0n1p3] Jun 14 20:18:03.401755 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.401687 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 20:18:03.406482 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.406346 2576 manager.go:216] Machine: {Timestamp:2026-06-14 20:18:03.405241861 +0000 UTC m=+0.275021304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100401 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e0c9d785646c0d1fd0d80b1b5c287 SystemUUID:ec2e0c9d-7856-46c0-d1fd-0d80b1b5c287 BootID:b40bfc81-b0eb-4f8d-88ef-4231eedd4c6a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c9:0e:da:1d:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c9:0e:da:1d:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:d9:a1:db:63:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 20:18:03.406482 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.406471 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 20:18:03.406605 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.406567 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 20:18:03.408672 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.408657 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 20:18:03.409078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.409057 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 20:18:03.409229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.409083 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 20:18:03.409807 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.409797 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 20:18:03.409839 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.409810 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 20:18:03.409839 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.409818 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 20:18:03.410399 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.410388 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 20:18:03.411638 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.411628 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 20:18:03.414584 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414573 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 14 20:18:03.414814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414804 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 20:18:03.414846 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414832 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 14 20:18:03.414846 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414841 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 20:18:03.414899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414855 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 20:18:03.414899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414865 2576 kubelet.go:398] "Adding apiserver pod source" Jun 14 20:18:03.414899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.414873 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 20:18:03.415190 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.415179 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 20:18:03.415231 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.415196 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 20:18:03.417106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.417089 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 20:18:03.418500 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418485 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 20:18:03.418577 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418522 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 20:18:03.418716 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418703 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 20:18:03.418773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418722 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 20:18:03.418773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418731 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 20:18:03.418773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418739 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 20:18:03.418773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418751 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 20:18:03.418773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.418759 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 20:18:03.419320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419310 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 20:18:03.419369 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419322 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 20:18:03.419369 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419332 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 20:18:03.419369 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419341 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 20:18:03.419369 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419361 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 20:18:03.419498 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.419374 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 20:18:03.420020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.420010 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 20:18:03.420065 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.420022 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 20:18:03.423088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.423073 2576 server.go:1268] "Started kubelet" Jun 14 20:18:03.423178 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.423142 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 20:18:03.423236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.423156 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 20:18:03.423236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.423199 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 20:18:03.423834 ip-10-0-129-240 systemd[1]: Started Kubernetes Kubelet. Jun 14 20:18:03.424930 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.424787 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 20:18:03.426680 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.426661 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 14 20:18:03.427321 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.427290 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 20:18:03.427432 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.427341 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 20:18:03.427497 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.427430 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 20:18:03.428929 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.427637 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-240.ec2.internal.18b90bf7140e411e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-240.ec2.internal,UID:ip-10-0-129-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-240.ec2.internal,},FirstTimestamp:2026-06-14 20:18:03.423047966 +0000 UTC m=+0.292827390,LastTimestamp:2026-06-14 20:18:03.423047966 +0000 UTC m=+0.292827390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-240.ec2.internal,}" Jun 14 20:18:03.430770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.430752 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 20:18:03.430770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.430764 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 20:18:03.430911 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.430822 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.431395 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431371 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 20:18:03.431478 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431398 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 20:18:03.431478 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431382 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 20:18:03.431564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431507 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 14 20:18:03.431564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431517 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 14 20:18:03.431720 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431704 2576 factory.go:55] Registering systemd factory Jun 14 20:18:03.431788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431723 2576 factory.go:223] Registration of the systemd container factory successfully Jun 14 20:18:03.431835 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.431820 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 20:18:03.431915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431897 2576 factory.go:153] Registering CRI-O factory Jun 14 20:18:03.431915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.431917 2576 factory.go:223] Registration of the crio container factory successfully Jun 14 20:18:03.432052 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.432001 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 20:18:03.432052 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.432026 2576 factory.go:103] Registering Raw factory Jun 14 20:18:03.432052 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.432039 2576 manager.go:1196] Started watching for new ooms in manager Jun 14 20:18:03.432372 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.432362 2576 manager.go:349] Starting recovery of all containers Jun 14 20:18:03.433033 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.433005 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 20:18:03.433116 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.433091 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 20:18:03.442276 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.442261 2576 manager.go:354] Recovery completed Jun 14 20:18:03.446363 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.446350 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.448328 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448205 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.448328 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448243 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.448328 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448257 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.448749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448733 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 20:18:03.448749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448746 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 20:18:03.448845 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448761 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 14 20:18:03.448845 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.448775 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.449103 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.449087 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bmg9f" Jun 14 20:18:03.449556 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.449542 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.449627 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.449566 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.449627 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.449575 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.450607 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.450595 2576 policy_none.go:49] "None policy: Start" Jun 14 20:18:03.450649 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.450611 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 20:18:03.450649 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.450621 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 20:18:03.451813 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.451803 2576 policy_none.go:47] "Start" Jun 14 20:18:03.456795 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.456769 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bmg9f" Jun 14 20:18:03.457579 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.457489 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-240.ec2.internal.18b90bf7158e6d61 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-240.ec2.internal,UID:ip-10-0-129-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-240.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-240.ec2.internal,},FirstTimestamp:2026-06-14 20:18:03.448225121 +0000 UTC m=+0.318004544,LastTimestamp:2026-06-14 20:18:03.448225121 +0000 UTC m=+0.318004544,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-240.ec2.internal,}" Jun 14 20:18:03.460065 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.460003 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-240.ec2.internal.18b90bf7158ed31d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-240.ec2.internal,UID:ip-10-0-129-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-240.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-240.ec2.internal,},FirstTimestamp:2026-06-14 20:18:03.448251165 +0000 UTC m=+0.318030589,LastTimestamp:2026-06-14 20:18:03.448251165 +0000 UTC m=+0.318030589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-240.ec2.internal,}" Jun 14 20:18:03.485705 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.485686 2576 manager.go:337] "Starting Device Plugin manager" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.485746 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.485758 2576 server.go:87] "Starting device plugin registration server" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.485941 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.485950 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.486066 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.486133 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.486141 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.486711 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.486780 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.491678 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.492741 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.492776 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.492792 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.492825 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 20:18:03.496566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.495435 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:03.587001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.586984 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.587765 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.587745 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.587868 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.587781 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.587868 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.587797 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.587868 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.587821 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.593435 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.593418 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal"] Jun 14 20:18:03.593487 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.593475 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.594131 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.594117 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.594195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.594142 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.594195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.594170 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.595357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.595346 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.595474 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.595460 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.595511 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.595493 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.595992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.595974 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.595992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.595991 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.596141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.596005 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.596141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.596009 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.596141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.596047 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.596141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.596022 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.597240 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.597319 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597251 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:03.597679 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597661 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.597740 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.597686 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-240.ec2.internal\": node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.597871 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597854 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:03.597949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597880 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:03.597949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.597893 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:03.617290 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.617250 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.627672 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.627653 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-240.ec2.internal\" not found" node="ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.631814 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.631799 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-240.ec2.internal\" not found" node="ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.631864 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.631840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.631910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.631860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.631910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.631884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/908085b0180256939b383508bf56d1cc-config\") pod \"kube-apiserver-proxy-ip-10-0-129-240.ec2.internal\" (UID: \"908085b0180256939b383508bf56d1cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.717518 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.717498 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.732776 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.732850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/908085b0180256939b383508bf56d1cc-config\") pod \"kube-apiserver-proxy-ip-10-0-129-240.ec2.internal\" (UID: \"908085b0180256939b383508bf56d1cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.732907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732846 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.732907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.732907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4678e42a83e08720ccb29b486e749ed5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal\" (UID: \"4678e42a83e08720ccb29b486e749ed5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.732907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.732878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/908085b0180256939b383508bf56d1cc-config\") pod \"kube-apiserver-proxy-ip-10-0-129-240.ec2.internal\" (UID: \"908085b0180256939b383508bf56d1cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.817937 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.817913 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.918759 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:03.918696 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:03.929846 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.929827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:03.935049 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:03.935025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:04.019012 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.018974 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.119539 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.119509 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.220017 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.219957 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.320550 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.320521 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.374995 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.374962 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 20:18:04.375594 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.375102 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 20:18:04.421492 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.421471 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.461475 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.461433 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 20:13:03 +0000 UTC" deadline="2028-02-12 04:31:42.61902137 +0000 UTC" Jun 14 20:18:04.461475 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.461469 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14576h13m38.157556891s" Jun 14 20:18:04.497155 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.497089 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 20:18:04.497936 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.497921 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientMemory" Jun 14 20:18:04.498010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.497974 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 20:18:04.498010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.497985 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeHasSufficientPID" Jun 14 20:18:04.521711 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.521692 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.542984 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:04.542951 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4678e42a83e08720ccb29b486e749ed5.slice/crio-aafb6a58936a1772b1e638cc0ce9bff5977d9f7f44518a93078d47da25163849 WatchSource:0}: Error finding container aafb6a58936a1772b1e638cc0ce9bff5977d9f7f44518a93078d47da25163849: Status 404 returned error can't find the container with id aafb6a58936a1772b1e638cc0ce9bff5977d9f7f44518a93078d47da25163849 Jun 14 20:18:04.543240 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:04.543222 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908085b0180256939b383508bf56d1cc.slice/crio-b00f2042712a7007102761baa6a5d69cbc2526cc9b51f73bc80d2062f24d5c26 WatchSource:0}: Error finding container b00f2042712a7007102761baa6a5d69cbc2526cc9b51f73bc80d2062f24d5c26: Status 404 returned error can't find the container with id b00f2042712a7007102761baa6a5d69cbc2526cc9b51f73bc80d2062f24d5c26 Jun 14 20:18:04.549472 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.549374 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:18:04.622600 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.622575 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.723078 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.723053 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.786244 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.786182 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:04.823364 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:04.823315 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-240.ec2.internal\" not found" Jun 14 20:18:04.840848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.840828 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:04.848427 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.847225 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:04.931486 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.931459 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" Jun 14 20:18:04.943320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.943297 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 20:18:04.944170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.944143 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" Jun 14 20:18:04.952049 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:04.952021 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 20:18:05.416106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.416073 2576 apiserver.go:52] "Watching apiserver" Jun 14 20:18:05.422833 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.422808 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 20:18:05.424061 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.424028 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-64cqb","openshift-network-operator/iptables-alerter-ff9w2","openshift-ovn-kubernetes/ovnkube-node-g5xn5","kube-system/konnectivity-agent-mwdnx","openshift-dns/node-resolver-jrk6k","openshift-image-registry/node-ca-vbwmz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal","openshift-multus/multus-additional-cni-plugins-pwkps","openshift-multus/multus-n528f","openshift-multus/network-metrics-daemon-v6d4n","kube-system/global-pull-secret-syncer-z4l54","kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8","openshift-cluster-node-tuning-operator/tuned-pvnsd"] Jun 14 20:18:05.425572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.425553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.425657 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.425636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:05.426830 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.426811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.428133 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.428111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.429658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.429469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 20:18:05.429658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.429500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vj8g5\"" Jun 14 20:18:05.429658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.429521 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.429861 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.429731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.430500 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.430195 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.431177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.430678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9gch9\"" Jun 14 20:18:05.431177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.430743 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.431177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.430891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 20:18:05.431177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431014 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.431177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431110 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 20:18:05.431514 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431252 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 20:18:05.431514 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431305 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 20:18:05.431514 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.431709 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.431674 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 20:18:05.432227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.432007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 20:18:05.432412 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.432391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qfbdx\"" Jun 14 20:18:05.432966 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.432506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 20:18:05.432966 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.432607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.433587 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.433542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-46lc6\"" Jun 14 20:18:05.433689 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.433611 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.434213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.433826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.434213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.433885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n528f" Jun 14 20:18:05.434874 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.434855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.435175 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.435140 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bmkwf\"" Jun 14 20:18:05.435726 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.435481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.435946 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.435929 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.436921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.436899 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwdc7\"" Jun 14 20:18:05.437411 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.437389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.437694 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.437674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.438704 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.438289 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 20:18:05.438704 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.438442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 20:18:05.440548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.439177 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.440754 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.440816 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.440827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.440876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jxkm7\"" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.440993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.441059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.441025 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tdcpn\"" Jun 14 20:18:05.441417 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.441182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.441658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.441636 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.441780 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.441737 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 20:18:05.442366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.442099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-etc-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.442366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.442164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2j78\" (UniqueName: \"kubernetes.io/projected/14f6d87b-b0c1-4f7b-b140-c350dce18e94-kube-api-access-n2j78\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.442366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.442199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xws77\" (UniqueName: \"kubernetes.io/projected/8b05a51a-4f76-43dd-9d3d-13ada924c188-kube-api-access-xws77\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.442366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.442304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-sys\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.442366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.442335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-tmp\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.443039 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgq9w\" (UniqueName: \"kubernetes.io/projected/07ad4325-7ff9-49a6-916b-0b44d777fd96-kube-api-access-fgq9w\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.443500 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.443593 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.443545 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:05.443654 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-agent-certs\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.443708 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-konnectivity-ca\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.443708 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.443708 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-systemd-units\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-modprobe-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443728 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysconfig\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-registration-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-sys-fs\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-kubelet\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-env-overrides\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.443905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-etc-tuned\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8jsw\" (UniqueName: \"kubernetes.io/projected/452be856-af27-455c-b5cb-de5423a1dacb-kube-api-access-c8jsw\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-bin\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.443996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-slash\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-netns\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-ovn\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-node-log\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovn-node-metrics-cert\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-systemd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-var-lib-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-script-lib\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b05a51a-4f76-43dd-9d3d-13ada924c188-hosts-file\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.444352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-kubernetes\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-conf\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-systemd\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-socket-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-config\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444466 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-run\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-lib-modules\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-var-lib-kubelet\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-host\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-netd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-device-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5d22\" (UniqueName: \"kubernetes.io/projected/040bab76-0324-4a9a-b395-cf81d78c52be-kube-api-access-v5d22\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-log-socket\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.445088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.444750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b05a51a-4f76-43dd-9d3d-13ada924c188-tmp-dir\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.446137 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.446117 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.448796 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.448569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 20:18:05.448796 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.448610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 20:18:05.449330 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.449095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5xmq\"" Jun 14 20:18:05.449330 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.449178 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 20:18:05.462908 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.462888 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg8gn" Jun 14 20:18:05.469917 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.469777 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg8gn" Jun 14 20:18:05.498828 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.498791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" event={"ID":"4678e42a83e08720ccb29b486e749ed5","Type":"ContainerStarted","Data":"aafb6a58936a1772b1e638cc0ce9bff5977d9f7f44518a93078d47da25163849"} Jun 14 20:18:05.500399 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.500380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" event={"ID":"908085b0180256939b383508bf56d1cc","Type":"ContainerStarted","Data":"b00f2042712a7007102761baa6a5d69cbc2526cc9b51f73bc80d2062f24d5c26"} Jun 14 20:18:05.532555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.532537 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 20:18:05.545523 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-systemd-units\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.545523 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-modprobe-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.545523 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545479 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-modprobe-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.545523 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-systemd-units\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.545806 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-system-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.545806 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b9b004-e32a-4f03-8c5c-743a85364eb0-host-slash\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.545806 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-kubelet-config\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.545949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-registration-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.545949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-env-overrides\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.546044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-etc-tuned\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.546044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.545982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8jsw\" (UniqueName: \"kubernetes.io/projected/452be856-af27-455c-b5cb-de5423a1dacb-kube-api-access-c8jsw\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.546044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/777aa617-d758-4411-842e-4f8af4c0e336-host\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.546044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.546246 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-bin\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.546246 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.546246 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-node-log\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.546454 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-registration-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.546622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-env-overrides\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.546778 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546762 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-bin\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.546911 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.546889 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 20:18:05.547256 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.547238 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:05.547396 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovn-node-metrics-cert\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.547466 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-hostroot\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.547466 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.547453 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:06.047418473 +0000 UTC m=+2.917197911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:05.547573 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-node-log\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.547573 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-conf-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.547661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cni-binary-copy\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.547661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d9sw\" (UniqueName: \"kubernetes.io/projected/a6b9b004-e32a-4f03-8c5c-743a85364eb0-kube-api-access-5d9sw\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.547661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-config\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.547786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-run\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.547786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-lib-modules\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.547786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cnibin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.547786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-k8s-cni-cncf-io\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.547969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6b9b004-e32a-4f03-8c5c-743a85364eb0-iptables-alerter-script\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.547969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.547969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.547969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5d22\" (UniqueName: \"kubernetes.io/projected/040bab76-0324-4a9a-b395-cf81d78c52be-kube-api-access-v5d22\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.547969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-log-socket\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.547983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xws77\" (UniqueName: \"kubernetes.io/projected/8b05a51a-4f76-43dd-9d3d-13ada924c188-kube-api-access-xws77\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2j78\" (UniqueName: \"kubernetes.io/projected/14f6d87b-b0c1-4f7b-b140-c350dce18e94-kube-api-access-n2j78\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/777aa617-d758-4411-842e-4f8af4c0e336-serviceca\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-os-release\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.548213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgq9w\" (UniqueName: \"kubernetes.io/projected/07ad4325-7ff9-49a6-916b-0b44d777fd96-kube-api-access-fgq9w\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-konnectivity-ca\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-multus\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-daemon-config\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cfqr\" (UniqueName: \"kubernetes.io/projected/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-kube-api-access-5cfqr\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysconfig\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.548555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.548903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.548903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-sys-fs\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.548903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-lib-modules\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.548903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-run\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.549093 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549093 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-log-socket\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.549238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-d\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.549344 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.548654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-sys-fs\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.549344 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-kubelet\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549344 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-os-release\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.549501 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.549501 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-kubelet\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-conf\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.549598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.549598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-slash\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-netns\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysconfig\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-ovn\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-netns\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-sysctl-conf\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-slash\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-ovn\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-konnectivity-ca\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.549821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-etc-kubernetes\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-config\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-run-ovn-kubernetes\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-systemd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-var-lib-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.549997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-systemd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-script-lib\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550092 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-var-lib-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b05a51a-4f76-43dd-9d3d-13ada924c188-hosts-file\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-kubernetes\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b05a51a-4f76-43dd-9d3d-13ada924c188-hosts-file\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550410 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-kubernetes\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-systemd\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-host\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cnibin\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-socket-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-var-lib-kubelet\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2rf5\" (UniqueName: \"kubernetes.io/projected/777aa617-d758-4411-842e-4f8af4c0e336-kube-api-access-g2rf5\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovnkube-script-lib\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-bin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtt9r\" (UniqueName: \"kubernetes.io/projected/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-kube-api-access-mtt9r\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-var-lib-kubelet\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.550921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-netd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550959 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-etc-systemd\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.550938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-device-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551022 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-device-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-host\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b05a51a-4f76-43dd-9d3d-13ada924c188-tmp-dir\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-sys\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-host-cni-netd\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-etc-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-tmp\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-netns\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-multus-certs\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-dbus\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b05a51a-4f76-43dd-9d3d-13ada924c188-tmp-dir\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.552381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-agent-certs\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-socket-dir-parent\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-kubelet\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-etc-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/452be856-af27-455c-b5cb-de5423a1dacb-sys\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/040bab76-0324-4a9a-b395-cf81d78c52be-socket-dir\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.551935 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-etc-tuned\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.552002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14f6d87b-b0c1-4f7b-b140-c350dce18e94-ovn-node-metrics-cert\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.553227 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.552048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14f6d87b-b0c1-4f7b-b140-c350dce18e94-run-openvswitch\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.554713 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.554687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ea3ad83-f6c2-4bc9-8506-6163cfecf861-agent-certs\") pod \"konnectivity-agent-mwdnx\" (UID: \"5ea3ad83-f6c2-4bc9-8506-6163cfecf861\") " pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.555625 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.555593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452be856-af27-455c-b5cb-de5423a1dacb-tmp\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.558061 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.558041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8jsw\" (UniqueName: \"kubernetes.io/projected/452be856-af27-455c-b5cb-de5423a1dacb-kube-api-access-c8jsw\") pod \"tuned-pvnsd\" (UID: \"452be856-af27-455c-b5cb-de5423a1dacb\") " pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.562787 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.562684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgq9w\" (UniqueName: \"kubernetes.io/projected/07ad4325-7ff9-49a6-916b-0b44d777fd96-kube-api-access-fgq9w\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:05.563564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.563515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2j78\" (UniqueName: \"kubernetes.io/projected/14f6d87b-b0c1-4f7b-b140-c350dce18e94-kube-api-access-n2j78\") pod \"ovnkube-node-g5xn5\" (UID: \"14f6d87b-b0c1-4f7b-b140-c350dce18e94\") " pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.563564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.563555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xws77\" (UniqueName: \"kubernetes.io/projected/8b05a51a-4f76-43dd-9d3d-13ada924c188-kube-api-access-xws77\") pod \"node-resolver-jrk6k\" (UID: \"8b05a51a-4f76-43dd-9d3d-13ada924c188\") " pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.563718 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.563633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5d22\" (UniqueName: \"kubernetes.io/projected/040bab76-0324-4a9a-b395-cf81d78c52be-kube-api-access-v5d22\") pod \"aws-ebs-csi-driver-node-s7pd8\" (UID: \"040bab76-0324-4a9a-b395-cf81d78c52be\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.652417 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-hostroot\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-conf-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cni-binary-copy\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d9sw\" (UniqueName: \"kubernetes.io/projected/a6b9b004-e32a-4f03-8c5c-743a85364eb0-kube-api-access-5d9sw\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-hostroot\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-conf-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cnibin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-k8s-cni-cncf-io\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6b9b004-e32a-4f03-8c5c-743a85364eb0-iptables-alerter-script\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cnibin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/777aa617-d758-4411-842e-4f8af4c0e336-serviceca\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-os-release\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-k8s-cni-cncf-io\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-multus\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652866 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-os-release\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-daemon-config\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.652898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cfqr\" (UniqueName: \"kubernetes.io/projected/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-kube-api-access-5cfqr\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-os-release\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.652989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-cni-binary-copy\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-etc-kubernetes\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cnibin\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2rf5\" (UniqueName: \"kubernetes.io/projected/777aa617-d758-4411-842e-4f8af4c0e336-kube-api-access-g2rf5\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653096 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-os-release\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-bin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtt9r\" (UniqueName: \"kubernetes.io/projected/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-kube-api-access-mtt9r\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/777aa617-d758-4411-842e-4f8af4c0e336-serviceca\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653248 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cnibin\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-netns\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.653330 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:05.653534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-multus-certs\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-dbus\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.653394 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:06.153374616 +0000 UTC m=+3.023154040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-socket-dir-parent\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-etc-kubernetes\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-kubelet\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653391 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-multus\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-dbus\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-system-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-system-cni-dir\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b9b004-e32a-4f03-8c5c-743a85364eb0-host-slash\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-kubelet-config\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653566 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-kubelet\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/777aa617-d758-4411-842e-4f8af4c0e336-host\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6b9b004-e32a-4f03-8c5c-743a85364eb0-iptables-alerter-script\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653555 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-multus-certs\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-socket-dir-parent\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-var-lib-cni-bin\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-multus-daemon-config\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-host-run-netns\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/399af912-ad68-410a-a104-f4a21b9376d9-kubelet-config\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-system-cni-dir\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6b9b004-e32a-4f03-8c5c-743a85364eb0-host-slash\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653732 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/777aa617-d758-4411-842e-4f8af4c0e336-host\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.653871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.654760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.654071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.660079 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.660061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d9sw\" (UniqueName: \"kubernetes.io/projected/a6b9b004-e32a-4f03-8c5c-743a85364eb0-kube-api-access-5d9sw\") pod \"iptables-alerter-ff9w2\" (UID: \"a6b9b004-e32a-4f03-8c5c-743a85364eb0\") " pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.662432 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.662408 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:05.662432 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.662430 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:05.662606 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.662443 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:05.662606 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:05.662519 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:06.162502987 +0000 UTC m=+3.032282419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:05.663564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.663543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2rf5\" (UniqueName: \"kubernetes.io/projected/777aa617-d758-4411-842e-4f8af4c0e336-kube-api-access-g2rf5\") pod \"node-ca-vbwmz\" (UID: \"777aa617-d758-4411-842e-4f8af4c0e336\") " pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:05.663758 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.663731 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cfqr\" (UniqueName: \"kubernetes.io/projected/45fcfb79-ee10-4aa2-ae77-fa94c896f73b-kube-api-access-5cfqr\") pod \"multus-n528f\" (UID: \"45fcfb79-ee10-4aa2-ae77-fa94c896f73b\") " pod="openshift-multus/multus-n528f" Jun 14 20:18:05.663813 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.663768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtt9r\" (UniqueName: \"kubernetes.io/projected/3145a829-0b59-463f-8fd0-9fafc5d4d9e0-kube-api-access-mtt9r\") pod \"multus-additional-cni-plugins-pwkps\" (UID: \"3145a829-0b59-463f-8fd0-9fafc5d4d9e0\") " pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.748977 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.748908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" Jun 14 20:18:05.756099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.756074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:05.764905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.764885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:05.772496 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.772477 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jrk6k" Jun 14 20:18:05.780316 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.780299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" Jun 14 20:18:05.787921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.787904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n528f" Jun 14 20:18:05.796622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.796601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwkps" Jun 14 20:18:05.804483 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.804464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ff9w2" Jun 14 20:18:05.806805 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.806791 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 20:18:05.811935 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:05.811918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbwmz" Jun 14 20:18:06.056223 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:06.056135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:06.056377 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.056258 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:06.056377 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.056310 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:07.056297279 +0000 UTC m=+3.926076689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:06.157093 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:06.157066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:06.157296 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.157199 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:06.157296 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.157247 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:07.157235636 +0000 UTC m=+4.027015046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:06.258011 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:06.257978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:06.258167 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.258126 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:06.258167 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.258160 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:06.258248 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.258170 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:06.258248 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:06.258223 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:07.258210696 +0000 UTC m=+4.127990104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:06.471902 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:06.471813 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 20:13:05 +0000 UTC" deadline="2028-01-29 00:13:31.039734486 +0000 UTC" Jun 14 20:18:06.471902 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:06.471841 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14235h55m24.567897488s" Jun 14 20:18:06.600839 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.600777 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040bab76_0324_4a9a_b395_cf81d78c52be.slice/crio-b9eef3ae38b344063d23b7323302e8889e5f81c1da94104a666903aabe8c30a8 WatchSource:0}: Error finding container b9eef3ae38b344063d23b7323302e8889e5f81c1da94104a666903aabe8c30a8: Status 404 returned error can't find the container with id b9eef3ae38b344063d23b7323302e8889e5f81c1da94104a666903aabe8c30a8 Jun 14 20:18:06.602921 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.602884 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b05a51a_4f76_43dd_9d3d_13ada924c188.slice/crio-e3ff6898626579efd418d7564fac7cb1f380fe206482f253318ad83b3a05ae16 WatchSource:0}: Error finding container e3ff6898626579efd418d7564fac7cb1f380fe206482f253318ad83b3a05ae16: Status 404 returned error can't find the container with id e3ff6898626579efd418d7564fac7cb1f380fe206482f253318ad83b3a05ae16 Jun 14 20:18:06.607575 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.607543 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b9b004_e32a_4f03_8c5c_743a85364eb0.slice/crio-78bacf792c95182749d0e9df93ed427dbfa6be6ebf6ff478b758dfe1df1d3798 WatchSource:0}: Error finding container 78bacf792c95182749d0e9df93ed427dbfa6be6ebf6ff478b758dfe1df1d3798: Status 404 returned error can't find the container with id 78bacf792c95182749d0e9df93ed427dbfa6be6ebf6ff478b758dfe1df1d3798 Jun 14 20:18:06.609088 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.609063 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea3ad83_f6c2_4bc9_8506_6163cfecf861.slice/crio-5da1b88ccd01d5a6415a41beaab08b2b8da3c11984b8948871406f9dfc74ac39 WatchSource:0}: Error finding container 5da1b88ccd01d5a6415a41beaab08b2b8da3c11984b8948871406f9dfc74ac39: Status 404 returned error can't find the container with id 5da1b88ccd01d5a6415a41beaab08b2b8da3c11984b8948871406f9dfc74ac39 Jun 14 20:18:06.609855 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.609736 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452be856_af27_455c_b5cb_de5423a1dacb.slice/crio-c1dcbb7cb25a5039f52b25b58466e757eaa5fe3752d9a949433b5a359c665e07 WatchSource:0}: Error finding container c1dcbb7cb25a5039f52b25b58466e757eaa5fe3752d9a949433b5a359c665e07: Status 404 returned error can't find the container with id c1dcbb7cb25a5039f52b25b58466e757eaa5fe3752d9a949433b5a359c665e07 Jun 14 20:18:06.611307 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.611206 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777aa617_d758_4411_842e_4f8af4c0e336.slice/crio-c02a7f11ee32dc6378f8b205d9ecec7efa726c3fd40300fe957dff5f91e19175 WatchSource:0}: Error finding container c02a7f11ee32dc6378f8b205d9ecec7efa726c3fd40300fe957dff5f91e19175: Status 404 returned error can't find the container with id c02a7f11ee32dc6378f8b205d9ecec7efa726c3fd40300fe957dff5f91e19175 Jun 14 20:18:06.611584 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.611560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3145a829_0b59_463f_8fd0_9fafc5d4d9e0.slice/crio-1914c27538ac7176e5aa7410f9af68ac23c07684fe57a4c738db02a6e458617f WatchSource:0}: Error finding container 1914c27538ac7176e5aa7410f9af68ac23c07684fe57a4c738db02a6e458617f: Status 404 returned error can't find the container with id 1914c27538ac7176e5aa7410f9af68ac23c07684fe57a4c738db02a6e458617f Jun 14 20:18:06.614049 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.613957 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fcfb79_ee10_4aa2_ae77_fa94c896f73b.slice/crio-80b9703f5fa7c1f2e2f24e5961aa4a25b7781b6a607d2f5aa9242b973d5df5c7 WatchSource:0}: Error finding container 80b9703f5fa7c1f2e2f24e5961aa4a25b7781b6a607d2f5aa9242b973d5df5c7: Status 404 returned error can't find the container with id 80b9703f5fa7c1f2e2f24e5961aa4a25b7781b6a607d2f5aa9242b973d5df5c7 Jun 14 20:18:06.614869 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:06.614407 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f6d87b_b0c1_4f7b_b140_c350dce18e94.slice/crio-7a748bb633b85831c92413102199ab9839f20d910e6fd619565381decb8ce3fa WatchSource:0}: Error finding container 7a748bb633b85831c92413102199ab9839f20d910e6fd619565381decb8ce3fa: Status 404 returned error can't find the container with id 7a748bb633b85831c92413102199ab9839f20d910e6fd619565381decb8ce3fa Jun 14 20:18:07.063765 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.063726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:07.063959 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.063888 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:07.063959 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.063958 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:09.063938398 +0000 UTC m=+5.933717822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:07.164850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.164773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:07.164991 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.164943 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:07.165059 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.165001 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:09.164982111 +0000 UTC m=+6.034761525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:07.265645 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.265613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:07.265813 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.265796 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:07.265901 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.265822 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:07.265901 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.265834 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:07.265901 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.265890 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:09.265870807 +0000 UTC m=+6.135650220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:07.472172 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.472030 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 20:13:05 +0000 UTC" deadline="2028-03-26 22:54:34.515144838 +0000 UTC" Jun 14 20:18:07.472172 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.472084 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15626h36m27.043065556s" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.493516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.493516 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.493658 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.493738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.493795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:07.495476 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:07.493867 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:07.522772 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.522650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"7a748bb633b85831c92413102199ab9839f20d910e6fd619565381decb8ce3fa"} Jun 14 20:18:07.533567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.533536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n528f" event={"ID":"45fcfb79-ee10-4aa2-ae77-fa94c896f73b","Type":"ContainerStarted","Data":"80b9703f5fa7c1f2e2f24e5961aa4a25b7781b6a607d2f5aa9242b973d5df5c7"} Jun 14 20:18:07.539872 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.539843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerStarted","Data":"1914c27538ac7176e5aa7410f9af68ac23c07684fe57a4c738db02a6e458617f"} Jun 14 20:18:07.548063 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.548028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbwmz" event={"ID":"777aa617-d758-4411-842e-4f8af4c0e336","Type":"ContainerStarted","Data":"c02a7f11ee32dc6378f8b205d9ecec7efa726c3fd40300fe957dff5f91e19175"} Jun 14 20:18:07.556533 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.556509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" event={"ID":"452be856-af27-455c-b5cb-de5423a1dacb","Type":"ContainerStarted","Data":"c1dcbb7cb25a5039f52b25b58466e757eaa5fe3752d9a949433b5a359c665e07"} Jun 14 20:18:07.560921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.560874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ff9w2" event={"ID":"a6b9b004-e32a-4f03-8c5c-743a85364eb0","Type":"ContainerStarted","Data":"78bacf792c95182749d0e9df93ed427dbfa6be6ebf6ff478b758dfe1df1d3798"} Jun 14 20:18:07.567407 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.567380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" event={"ID":"908085b0180256939b383508bf56d1cc","Type":"ContainerStarted","Data":"74fc59fc8bad1c5f34a98d6f8de9657304598f4270101e0f66e712d8f6fbbe47"} Jun 14 20:18:07.585201 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.585175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwdnx" event={"ID":"5ea3ad83-f6c2-4bc9-8506-6163cfecf861","Type":"ContainerStarted","Data":"5da1b88ccd01d5a6415a41beaab08b2b8da3c11984b8948871406f9dfc74ac39"} Jun 14 20:18:07.595208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.595182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrk6k" event={"ID":"8b05a51a-4f76-43dd-9d3d-13ada924c188","Type":"ContainerStarted","Data":"e3ff6898626579efd418d7564fac7cb1f380fe206482f253318ad83b3a05ae16"} Jun 14 20:18:07.608668 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.608640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" event={"ID":"040bab76-0324-4a9a-b395-cf81d78c52be","Type":"ContainerStarted","Data":"b9eef3ae38b344063d23b7323302e8889e5f81c1da94104a666903aabe8c30a8"} Jun 14 20:18:07.625248 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.625222 2576 generic.go:356] "Generic (PLEG): container finished" podID="4678e42a83e08720ccb29b486e749ed5" containerID="cac94a4e3d25a4e3e08a8c50239d1190878913b95cd1ccb5a5760197092dbd58" exitCode=0 Jun 14 20:18:07.625362 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.625261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" event={"ID":"4678e42a83e08720ccb29b486e749ed5","Type":"ContainerDied","Data":"cac94a4e3d25a4e3e08a8c50239d1190878913b95cd1ccb5a5760197092dbd58"} Jun 14 20:18:07.641381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:07.641335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-240.ec2.internal" podStartSLOduration=3.641317789 podStartE2EDuration="3.641317789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:07.583534587 +0000 UTC m=+4.453314018" watchObservedRunningTime="2026-06-14 20:18:07.641317789 +0000 UTC m=+4.511097222" Jun 14 20:18:08.643165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:08.640680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" event={"ID":"4678e42a83e08720ccb29b486e749ed5","Type":"ContainerStarted","Data":"bfefd00c5ca3bf8529de7a873b61f894535d39c7a0b78ce44d8aefef61f4bcaf"} Jun 14 20:18:09.084493 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.084399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:09.084653 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.084593 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:09.084714 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.084657 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:13.084638311 +0000 UTC m=+9.954417743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:09.185702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.185667 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:09.185880 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.185829 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:09.185956 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.185886 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:13.185869304 +0000 UTC m=+10.055648722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:09.286275 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.286239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:09.286517 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.286455 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:09.286517 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.286480 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:09.286517 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.286495 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:09.286679 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.286550 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:13.286533421 +0000 UTC m=+10.156312835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:09.496142 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.496064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:09.496319 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.496207 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:09.496641 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.496620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:09.496748 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.496729 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:09.496818 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:09.496786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:09.496883 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:09.496853 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:11.493318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:11.493460 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:11.493331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:11.493494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:11.493551 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:11.494170 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:11.493612 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:13.117469 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.117430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:13.117913 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.117616 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:13.117913 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.117684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.117663269 +0000 UTC m=+17.987442679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:13.218731 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.218139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:13.218731 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.218344 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:13.218731 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.218415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.21839487 +0000 UTC m=+18.088174283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:13.318601 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.318562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:13.318766 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.318717 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:13.318766 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.318740 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:13.318766 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.318749 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:13.318898 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.318797 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:21.318781354 +0000 UTC m=+18.188560763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:13.495751 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.495287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:13.495751 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.495407 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:13.495751 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.495449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:13.495751 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.495555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:13.495751 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:13.495571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:13.496086 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:13.496047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:15.494348 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:15.494313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:15.494792 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:15.494436 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:15.494792 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:15.494482 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:15.494792 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:15.494501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:15.494792 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:15.494578 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:15.494792 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:15.494652 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:17.494077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:17.493953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:17.494077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:17.493986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:17.494077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:17.493953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:17.494663 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:17.494073 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:17.494663 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:17.494183 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:17.494663 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:17.494274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:19.493400 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:19.493363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:19.493862 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:19.493364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:19.493862 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:19.493487 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:19.493862 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:19.493377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:19.493862 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:19.493560 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:19.493862 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:19.493655 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:21.183319 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.183286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:21.183747 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.183453 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:21.183747 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.183526 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:37.183505523 +0000 UTC m=+34.053284942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:21.283927 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.283881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:21.284092 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.284038 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:21.284139 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.284120 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:37.284103201 +0000 UTC m=+34.153882609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:21.384859 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.384826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:21.385021 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.384995 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:21.385021 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.385021 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:21.385099 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.385030 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:21.385099 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.385081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:37.385068885 +0000 UTC m=+34.254848311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:21.493993 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.493906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:21.493993 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.493938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:21.494212 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:21.493906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:21.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.494026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:21.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.494082 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:21.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:21.494174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:23.493901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:23.493874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:23.494456 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:23.493953 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:23.494456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:23.493999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:23.494456 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:23.494073 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:23.494456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:23.494115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:23.494456 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:23.494249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:25.494030 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.493838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:25.494535 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.493838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:25.494535 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:25.494107 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:25.494535 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.493892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:25.494535 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:25.494187 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:25.494535 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:25.494278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:25.678990 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.678959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:18:25.679353 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679323 2576 generic.go:356] "Generic (PLEG): container finished" podID="14f6d87b-b0c1-4f7b-b140-c350dce18e94" containerID="3658bd6d8fa1030e059726d99ed875b3cdbf83db62dfcb6dae091ceb512a6919" exitCode=1 Jun 14 20:18:25.679488 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679390 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"b563d642bb2ac1f15d4158d60c0b080968d79fd7fed3a938f37102470cc4c3e4"} Jun 14 20:18:25.679488 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"17b84472e435d929a36fb0a8c80180d6e9c83c4d5e29876af3cc95fdfaee2593"} Jun 14 20:18:25.679599 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"c7e53798a26dc2a353d3070f39b03679bf7fe8f1b795ed3565ba0cbd7ccccae4"} Jun 14 20:18:25.679599 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"c3f18f3686c09a7fffd7fef7e81db0404a796bb3f5f35b99a2ea05c550a1aaed"} Jun 14 20:18:25.679599 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679597 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerDied","Data":"3658bd6d8fa1030e059726d99ed875b3cdbf83db62dfcb6dae091ceb512a6919"} Jun 14 20:18:25.679793 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.679637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"b6970a36efd2596d49ac70e2f89c4e1e2ec590f72daa1dfb43f52e1ab6c03772"} Jun 14 20:18:25.681075 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.681048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n528f" event={"ID":"45fcfb79-ee10-4aa2-ae77-fa94c896f73b","Type":"ContainerStarted","Data":"1a34adb86a7407e79dfb1b1fadccc3b776af35d599f7c1c482e97ea3faaf3e61"} Jun 14 20:18:25.683408 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.683385 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="4e30516773e410db28a4c5b35a79b97c5207fb78034f913151d38218da5ec531" exitCode=0 Jun 14 20:18:25.683504 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.683462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"4e30516773e410db28a4c5b35a79b97c5207fb78034f913151d38218da5ec531"} Jun 14 20:18:25.689031 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.689003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbwmz" event={"ID":"777aa617-d758-4411-842e-4f8af4c0e336","Type":"ContainerStarted","Data":"3b35b489ed6d79fc29a1331ef8c5879235676888b9b040710862488d259ad789"} Jun 14 20:18:25.690988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.690951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" event={"ID":"452be856-af27-455c-b5cb-de5423a1dacb","Type":"ContainerStarted","Data":"d7a8729c16c2c8fe84ea69cd2b4d0d8e9d119ac189855abd8c77041ca1a26874"} Jun 14 20:18:25.692459 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.692421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwdnx" event={"ID":"5ea3ad83-f6c2-4bc9-8506-6163cfecf861","Type":"ContainerStarted","Data":"9bf2beaae596086dd67c103021ef343f504e0bbb78224604de354b11ab19948c"} Jun 14 20:18:25.694116 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.694094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jrk6k" event={"ID":"8b05a51a-4f76-43dd-9d3d-13ada924c188","Type":"ContainerStarted","Data":"3cddce2fbc204395b5796a501a6c15f915bad8633794ab970a1fcfd953286f0d"} Jun 14 20:18:25.695834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.695810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" event={"ID":"040bab76-0324-4a9a-b395-cf81d78c52be","Type":"ContainerStarted","Data":"666971afbf5d9046f7af99ff2be7b124a94a6abcd6140beee523118613a0a08b"} Jun 14 20:18:25.699797 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.699753 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-240.ec2.internal" podStartSLOduration=21.699737176 podStartE2EDuration="21.699737176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:08.658328138 +0000 UTC m=+5.528107570" watchObservedRunningTime="2026-06-14 20:18:25.699737176 +0000 UTC m=+22.569516611" Jun 14 20:18:25.699973 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.699947 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n528f" podStartSLOduration=4.396465325 podStartE2EDuration="22.699938158s" totalImagesPullingTime="18.303472833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:25.699290722 +0000 UTC m=+22.569070174" watchObservedRunningTime="2026-06-14 20:18:25.699938158 +0000 UTC m=+22.569717593" Jun 14 20:18:25.712391 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.712353 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vbwmz" podStartSLOduration=3.461324595 podStartE2EDuration="21.712338891s" totalImagesPullingTime="18.251014296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:25.711864955 +0000 UTC m=+22.581644387" watchObservedRunningTime="2026-06-14 20:18:25.712338891 +0000 UTC m=+22.582118321" Jun 14 20:18:25.717594 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.717579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:25.718121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.718103 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:25.725692 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.725661 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwdnx" podStartSLOduration=9.149587585 podStartE2EDuration="22.725650386s" totalImagesPullingTime="13.576062801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:25.725462995 +0000 UTC m=+22.595242428" watchObservedRunningTime="2026-06-14 20:18:25.725650386 +0000 UTC m=+22.595429829" Jun 14 20:18:25.741993 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.741927 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pvnsd" podStartSLOduration=4.447844215 podStartE2EDuration="22.741917045s" totalImagesPullingTime="18.29407283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:25.741407447 +0000 UTC m=+22.611186880" watchObservedRunningTime="2026-06-14 20:18:25.741917045 +0000 UTC m=+22.611696475" Jun 14 20:18:25.807057 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:25.807006 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jrk6k" podStartSLOduration=9.226569233 podStartE2EDuration="22.806992305s" totalImagesPullingTime="13.580423072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:25.789738075 +0000 UTC m=+22.659517505" watchObservedRunningTime="2026-06-14 20:18:25.806992305 +0000 UTC m=+22.676771736" Jun 14 20:18:26.682608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.682468 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 20:18:26.699455 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.699416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" event={"ID":"040bab76-0324-4a9a-b395-cf81d78c52be","Type":"ContainerStarted","Data":"18749e3fcecdd5a8447a8e137ac7d9f04ea02f84bc3b6c3b004488313ad4aac9"} Jun 14 20:18:26.701073 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.701006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ff9w2" event={"ID":"a6b9b004-e32a-4f03-8c5c-743a85364eb0","Type":"ContainerStarted","Data":"89951e09012e20c721aa88aaadf2002d117db70b413d881fa07222dffaa266f4"} Jun 14 20:18:26.701828 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.701811 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:26.702355 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.702316 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwdnx" Jun 14 20:18:26.715820 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:26.715777 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ff9w2" podStartSLOduration=5.460424909 podStartE2EDuration="23.715760407s" totalImagesPullingTime="18.255335498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:26.715291719 +0000 UTC m=+23.585071150" watchObservedRunningTime="2026-06-14 20:18:26.715760407 +0000 UTC m=+23.585539840" Jun 14 20:18:27.493444 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.493360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:27.493603 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.493360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:27.493603 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:27.493494 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:27.493685 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:27.493599 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:27.493685 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.493656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:27.493757 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:27.493726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:27.499817 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.499720 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T20:18:26.682605423Z","UUID":"4f754ed8-0fb4-44e2-8f42-42ca69fe8e44","Handler":null,"Name":"","Endpoint":""} Jun 14 20:18:27.501607 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.501584 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 20:18:27.501723 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:27.501637 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 20:18:28.708402 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:28.708361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" event={"ID":"040bab76-0324-4a9a-b395-cf81d78c52be","Type":"ContainerStarted","Data":"8fc64de8d1e4ab9f39c21dcce1a8a5bb27c9cc24f2cc3fdb57311d30cd49f08d"} Jun 14 20:18:28.711765 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:28.711745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:18:28.712241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:28.712205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"9794a88ed5200d1a819cf46727658d658578bb10c48bc1bee1ac7f7336e7d2a7"} Jun 14 20:18:28.727925 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:28.727885 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7pd8" podStartSLOduration=5.075067112 podStartE2EDuration="25.727871351s" totalImagesPullingTime="20.652804239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:28.727863757 +0000 UTC m=+25.597643189" watchObservedRunningTime="2026-06-14 20:18:28.727871351 +0000 UTC m=+25.597650785" Jun 14 20:18:29.493232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:29.493200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:29.493398 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:29.493210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:29.493398 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:29.493316 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:29.493522 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:29.493401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:29.493522 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:29.493209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:29.493522 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:29.493490 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:31.493741 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.493571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:31.494212 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.493577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:31.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:31.493818 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:31.494212 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.493577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:31.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:31.493883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:31.494212 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:31.493977 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:31.721872 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.721851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:18:31.722236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.722214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"e101d79f623a02c903e0cada2718ba47caba6d403b5b4377a9a510b3863a2189"} Jun 14 20:18:31.722514 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.722471 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:31.722626 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.722546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:31.722676 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.722649 2576 scope.go:117] "RemoveContainer" containerID="3658bd6d8fa1030e059726d99ed875b3cdbf83db62dfcb6dae091ceb512a6919" Jun 14 20:18:31.724133 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.724112 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="cb1a62a8218271d26ead5ed325da91c15e60cfa287c7b4ec6cc7d364a54d5460" exitCode=0 Jun 14 20:18:31.724216 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.724171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"cb1a62a8218271d26ead5ed325da91c15e60cfa287c7b4ec6cc7d364a54d5460"} Jun 14 20:18:31.738940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:31.738920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:32.732013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.731983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:18:32.732464 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.732429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" event={"ID":"14f6d87b-b0c1-4f7b-b140-c350dce18e94","Type":"ContainerStarted","Data":"1a6cfafafd35ea7a56dccc99be33d64255b4d90596f0c68c2a9f1c7e88ddbc45"} Jun 14 20:18:32.732883 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.732780 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:32.735288 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.735259 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="7f6b680991d50e3b3929360bdbc504e7ed48709e2cbf657e1840b1a486bbac62" exitCode=0 Jun 14 20:18:32.735381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.735293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"7f6b680991d50e3b3929360bdbc504e7ed48709e2cbf657e1840b1a486bbac62"} Jun 14 20:18:32.748911 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.748892 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:18:32.763172 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.763109 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" podStartSLOduration=11.414996662 podStartE2EDuration="29.763095187s" totalImagesPullingTime="18.348098525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:32.76292677 +0000 UTC m=+29.632706220" watchObservedRunningTime="2026-06-14 20:18:32.763095187 +0000 UTC m=+29.632874618" Jun 14 20:18:32.986733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.986644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4l54"] Jun 14 20:18:32.986883 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.986777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:32.986932 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:32.986884 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:32.989309 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.989284 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64cqb"] Jun 14 20:18:32.989433 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:32.989370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:32.989496 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:32.989433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:33.002671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:33.002644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v6d4n"] Jun 14 20:18:33.002769 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:33.002747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:33.002874 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:33.002852 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:33.739544 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:33.739321 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="a0a093f6b55143b7708178bc522f60e3d9edfc1aeb0209c43db1dae90a203560" exitCode=0 Jun 14 20:18:33.739901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:33.739383 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"a0a093f6b55143b7708178bc522f60e3d9edfc1aeb0209c43db1dae90a203560"} Jun 14 20:18:34.493799 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:34.493769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:34.493799 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:34.493769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:34.494036 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:34.493901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:34.494036 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:34.493935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:34.494170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:34.494043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:34.494230 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:34.494175 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:36.493783 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:36.493753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:36.494468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:36.493752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:36.494468 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:36.493866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:36.494468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:36.493752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:36.494468 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:36.493963 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:36.494468 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:36.494122 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:37.208777 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:37.208741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:37.209014 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.208871 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:37.209014 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.208939 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:09.208919462 +0000 UTC m=+66.078698878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 20:18:37.309860 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:37.309822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:37.310032 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.309955 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:37.310032 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.310028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret podName:399af912-ad68-410a-a104-f4a21b9376d9 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:09.310009592 +0000 UTC m=+66.179789026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret") pod "global-pull-secret-syncer-z4l54" (UID: "399af912-ad68-410a-a104-f4a21b9376d9") : object "kube-system"/"original-pull-secret" not registered Jun 14 20:18:37.410743 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:37.410706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:37.410917 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.410896 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 20:18:37.410965 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.410927 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 20:18:37.410965 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.410943 2576 projected.go:196] Error preparing data for projected volume kube-api-access-8p69c for pod openshift-network-diagnostics/network-check-target-64cqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:37.411043 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:37.411003 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c podName:0a49b3be-09f2-4f62-8806-381cd6abd659 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:09.410985274 +0000 UTC m=+66.280764688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8p69c" (UniqueName: "kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c") pod "network-check-target-64cqb" (UID: "0a49b3be-09f2-4f62-8806-381cd6abd659") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 20:18:38.493804 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.493747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:38.494271 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:38.493843 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z4l54" podUID="399af912-ad68-410a-a104-f4a21b9376d9" Jun 14 20:18:38.494271 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.493857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:38.494271 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:38.493946 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64cqb" podUID="0a49b3be-09f2-4f62-8806-381cd6abd659" Jun 14 20:18:38.494271 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.493982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:38.494271 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:38.494038 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:18:38.752874 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.752800 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="e27607c92996eecd0af71e22e50e1c6f018c53228bd473711044015f401402af" exitCode=0 Jun 14 20:18:38.752874 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.752859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"e27607c92996eecd0af71e22e50e1c6f018c53228bd473711044015f401402af"} Jun 14 20:18:38.977822 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.977798 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-240.ec2.internal" event="NodeReady" Jun 14 20:18:38.977929 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:38.977919 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 20:18:39.011685 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.011627 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:18:39.017065 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.017045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.019529 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.019500 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 20:18:39.019529 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.019513 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dldwt\"" Jun 14 20:18:39.019680 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.019537 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 20:18:39.019680 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.019510 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 20:18:39.021238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.021219 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ms2v6"] Jun 14 20:18:39.024401 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024504 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024504 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmw5d\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.024671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.024649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.025364 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.025343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 20:18:39.029043 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.029025 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9hc7f"] Jun 14 20:18:39.029165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.029131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.031471 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.031446 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 20:18:39.031571 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.031510 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 20:18:39.031745 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.031730 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qhwh9\"" Jun 14 20:18:39.035278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.035187 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:18:39.035278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.035239 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.035565 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.035376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ms2v6"] Jun 14 20:18:39.038094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.037988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 20:18:39.038094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.038003 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 20:18:39.038094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.038075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 20:18:39.038414 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.038396 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l9p5z\"" Jun 14 20:18:39.038930 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.038912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9hc7f"] Jun 14 20:18:39.125768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.125916 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.125916 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-config-volume\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.125916 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.125916 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.126132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.125996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npj86\" (UniqueName: \"kubernetes.io/projected/aea2eb77-e8ec-40e4-b060-6f64b7114c40-kube-api-access-npj86\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.126132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea2eb77-e8ec-40e4-b060-6f64b7114c40-cert\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.126132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-tmp-dir\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.126132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42bt4\" (UniqueName: \"kubernetes.io/projected/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-kube-api-access-42bt4\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmw5d\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.126256 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.126341 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:39.126385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126690 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.126406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:18:39.626387907 +0000 UTC m=+36.496167320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:39.126771 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126749 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.126881 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.126863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.129821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.129797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.129821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.129813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.134710 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.134691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.135043 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.135026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmw5d\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.163284 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.163254 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:39.227069 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42bt4\" (UniqueName: \"kubernetes.io/projected/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-kube-api-access-42bt4\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.227164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-config-volume\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.227164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.227245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npj86\" (UniqueName: \"kubernetes.io/projected/aea2eb77-e8ec-40e4-b060-6f64b7114c40-kube-api-access-npj86\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.227245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea2eb77-e8ec-40e4-b060-6f64b7114c40-cert\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.227245 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.227218 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:39.227383 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-tmp-dir\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.227383 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.227281 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:39.727264074 +0000 UTC m=+36.597043490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:39.227518 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-tmp-dir\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.227714 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.227685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-config-volume\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.229337 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.229318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea2eb77-e8ec-40e4-b060-6f64b7114c40-cert\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.235733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.235715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npj86\" (UniqueName: \"kubernetes.io/projected/aea2eb77-e8ec-40e4-b060-6f64b7114c40-kube-api-access-npj86\") pod \"ingress-canary-9hc7f\" (UID: \"aea2eb77-e8ec-40e4-b060-6f64b7114c40\") " pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.235859 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.235841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42bt4\" (UniqueName: \"kubernetes.io/projected/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-kube-api-access-42bt4\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.244400 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.244367 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:39.345000 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.344978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9hc7f" Jun 14 20:18:39.562512 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.562352 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:39.562892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.562538 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9hc7f"] Jun 14 20:18:39.566171 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:18:39.566134 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea2eb77_e8ec_40e4_b060_6f64b7114c40.slice/crio-51c8df6fae1b95942bb76f0483c2a0c86b1003c208e1826ab3a960173f4dc70f WatchSource:0}: Error finding container 51c8df6fae1b95942bb76f0483c2a0c86b1003c208e1826ab3a960173f4dc70f: Status 404 returned error can't find the container with id 51c8df6fae1b95942bb76f0483c2a0c86b1003c208e1826ab3a960173f4dc70f Jun 14 20:18:39.630044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.629980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:39.630134 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.630113 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:39.630196 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.630135 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:39.630236 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.630197 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:18:40.630182823 +0000 UTC m=+37.499962233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:39.659136 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.659113 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:39.715497 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.715473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:39.730549 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.730529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:39.730676 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.730662 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:39.730711 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:39.730707 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:40.730694929 +0000 UTC m=+37.600474338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:39.760589 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.760568 2576 generic.go:356] "Generic (PLEG): container finished" podID="3145a829-0b59-463f-8fd0-9fafc5d4d9e0" containerID="3d7e6107443f2b1ff970ed9107497774c5135f4b30308251b81d600a0d3ab947" exitCode=0 Jun 14 20:18:39.760688 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.760637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerDied","Data":"3d7e6107443f2b1ff970ed9107497774c5135f4b30308251b81d600a0d3ab947"} Jun 14 20:18:39.761814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:39.761784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9hc7f" event={"ID":"aea2eb77-e8ec-40e4-b060-6f64b7114c40","Type":"ContainerStarted","Data":"51c8df6fae1b95942bb76f0483c2a0c86b1003c208e1826ab3a960173f4dc70f"} Jun 14 20:18:40.493434 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.493263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:18:40.493599 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.493291 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:18:40.493947 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.493302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:18:40.498526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.498503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 20:18:40.499099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.498935 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 20:18:40.499099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.498959 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7cfxq\"" Jun 14 20:18:40.499099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.499068 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 20:18:40.499738 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.499719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5gdc\"" Jun 14 20:18:40.499838 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.499765 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 20:18:40.636428 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.636399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:40.636888 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:40.636504 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:40.636888 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:40.636523 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:40.636888 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:40.636600 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:18:42.636581476 +0000 UTC m=+39.506361113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:40.737299 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.737267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:40.737435 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:40.737421 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:40.737521 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:40.737512 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:42.737494018 +0000 UTC m=+39.607273447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:40.767131 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.767100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwkps" event={"ID":"3145a829-0b59-463f-8fd0-9fafc5d4d9e0","Type":"ContainerStarted","Data":"dfc5820a7ac1b1efc02c4f2f1d413e7a4debe8a061849cd693573d89c2a17f23"} Jun 14 20:18:40.790313 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.790256 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwkps" podStartSLOduration=8.108187017 podStartE2EDuration="37.790240565s" totalImagesPullingTime="29.682053548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:40.788454532 +0000 UTC m=+37.658233976" watchObservedRunningTime="2026-06-14 20:18:40.790240565 +0000 UTC m=+37.660019996" Jun 14 20:18:40.915678 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.915601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:40.970700 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:40.970629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:41.770920 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:41.770887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9hc7f" event={"ID":"aea2eb77-e8ec-40e4-b060-6f64b7114c40","Type":"ContainerStarted","Data":"c33ba8cfeb2559e83a9e519c5f882c3e35cc0d2cce40e57a90f23844447f127e"} Jun 14 20:18:41.786122 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:41.786078 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9hc7f" podStartSLOduration=0.728275388 podStartE2EDuration="2.786062313s" totalImagesPullingTime="2.057786925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:18:41.785025678 +0000 UTC m=+38.654805108" watchObservedRunningTime="2026-06-14 20:18:41.786062313 +0000 UTC m=+38.655841745" Jun 14 20:18:42.655939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:42.655900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:42.656104 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:42.656089 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:42.656190 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:42.656107 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:42.656246 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:42.656216 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:18:46.656175324 +0000 UTC m=+43.525954733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:42.756975 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:42.756945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:42.757092 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:42.757043 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:42.757092 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:42.757090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:46.757077705 +0000 UTC m=+43.626857113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:43.416623 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:43.416587 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:43.485269 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:43.485234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:43.548768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:43.548741 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:46.202924 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:46.202893 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:46.683411 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:46.683378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:46.683578 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:46.683492 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:46.683578 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:46.683505 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:46.683578 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:46.683556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:18:54.683542784 +0000 UTC m=+51.553322194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:46.784402 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:46.784374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:46.784531 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:46.784510 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:46.784583 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:46.784562 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:18:54.784546474 +0000 UTC m=+51.654325904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:48.566698 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:48.566663 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:48.670721 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:48.670689 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:48.943064 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:48.942981 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:49.011707 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:49.011665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:51.087349 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:51.087315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:51.187965 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:51.187926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:51.384897 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:51.384804 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:51.485370 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:51.485337 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:54.742924 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:54.742893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:18:54.743451 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:54.743007 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:18:54.743451 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:54.743019 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:18:54.743451 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:54.743079 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:19:10.743063789 +0000 UTC m=+67.612843197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:18:54.843844 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:54.843813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:18:54.843994 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:54.843972 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:18:54.844048 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:18:54.844038 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:10.844021982 +0000 UTC m=+67.713801395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:18:55.438157 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:55.438118 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:55.484946 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:55.484916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:55.633613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:55.633580 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:18:55.689199 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:18:55.689107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:04.752077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:04.752047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g5xn5" Jun 14 20:19:04.903215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:04.903183 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:04.953288 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:04.953253 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:09.241233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.241195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:19:09.243850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.243831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 20:19:09.251942 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:09.251924 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 20:19:09.252025 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:09.251978 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:20:13.251961911 +0000 UTC m=+130.121741320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : secret "metrics-daemon-secret" not found Jun 14 20:19:09.342012 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.341985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:19:09.344632 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.344616 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 20:19:09.356606 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.356578 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/399af912-ad68-410a-a104-f4a21b9376d9-original-pull-secret\") pod \"global-pull-secret-syncer-z4l54\" (UID: \"399af912-ad68-410a-a104-f4a21b9376d9\") " pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:19:09.442629 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.442604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:19:09.445294 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.445279 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 20:19:09.455302 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.455284 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 20:19:09.466280 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.466258 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p69c\" (UniqueName: \"kubernetes.io/projected/0a49b3be-09f2-4f62-8806-381cd6abd659-kube-api-access-8p69c\") pod \"network-check-target-64cqb\" (UID: \"0a49b3be-09f2-4f62-8806-381cd6abd659\") " pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:19:09.605374 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.605353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z4l54" Jun 14 20:19:09.620130 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.620112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5gdc\"" Jun 14 20:19:09.628284 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.628270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:19:09.780046 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.780019 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z4l54"] Jun 14 20:19:09.782555 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:19:09.782519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399af912_ad68_410a_a104_f4a21b9376d9.slice/crio-d977deeb37a26bdc59318fe7b9f4e5157d2aa8d715ef1ab4c7029d23bf846a62 WatchSource:0}: Error finding container d977deeb37a26bdc59318fe7b9f4e5157d2aa8d715ef1ab4c7029d23bf846a62: Status 404 returned error can't find the container with id d977deeb37a26bdc59318fe7b9f4e5157d2aa8d715ef1ab4c7029d23bf846a62 Jun 14 20:19:09.794777 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.794751 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64cqb"] Jun 14 20:19:09.798306 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:19:09.798272 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a49b3be_09f2_4f62_8806_381cd6abd659.slice/crio-994681ac482d28a5b3d3ff589c4eaf57478436239988f456f3c55f0c48ba4c88 WatchSource:0}: Error finding container 994681ac482d28a5b3d3ff589c4eaf57478436239988f456f3c55f0c48ba4c88: Status 404 returned error can't find the container with id 994681ac482d28a5b3d3ff589c4eaf57478436239988f456f3c55f0c48ba4c88 Jun 14 20:19:09.835845 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.835818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64cqb" event={"ID":"0a49b3be-09f2-4f62-8806-381cd6abd659","Type":"ContainerStarted","Data":"994681ac482d28a5b3d3ff589c4eaf57478436239988f456f3c55f0c48ba4c88"} Jun 14 20:19:09.836793 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:09.836775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4l54" event={"ID":"399af912-ad68-410a-a104-f4a21b9376d9","Type":"ContainerStarted","Data":"d977deeb37a26bdc59318fe7b9f4e5157d2aa8d715ef1ab4c7029d23bf846a62"} Jun 14 20:19:10.752875 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:10.752844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:19:10.753346 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:10.753042 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:19:10.753346 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:10.753062 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:19:10.753346 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:10.753124 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:19:42.753105342 +0000 UTC m=+99.622884758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:19:10.853860 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:10.853830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:19:10.854047 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:10.853971 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:19:10.854047 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:10.854030 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:19:42.854014219 +0000 UTC m=+99.723793628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:19:11.928788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:11.928753 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:11.987081 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:11.987038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:14.851170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:14.851116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64cqb" event={"ID":"0a49b3be-09f2-4f62-8806-381cd6abd659","Type":"ContainerStarted","Data":"da9708c47abcca5db56047efeaec85dcfd3ba17896f64d34422744c3fbf19110"} Jun 14 20:19:14.851713 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:14.851272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:19:14.852556 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:14.852535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z4l54" event={"ID":"399af912-ad68-410a-a104-f4a21b9376d9","Type":"ContainerStarted","Data":"e938334b7aa26f60b6c5a94f1065c350701e88ca82f5a4a9350ea6bf6d0f60ca"} Jun 14 20:19:14.867054 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:14.867010 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64cqb" podStartSLOduration=67.440655348 podStartE2EDuration="1m11.866996937s" totalImagesPullingTime="4.426341589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:14.866564273 +0000 UTC m=+71.736343703" watchObservedRunningTime="2026-06-14 20:19:14.866996937 +0000 UTC m=+71.736776368" Jun 14 20:19:14.879756 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:14.879713 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z4l54" podStartSLOduration=67.434460904 podStartE2EDuration="1m11.879700064s" totalImagesPullingTime="4.44523916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:14.879047046 +0000 UTC m=+71.748826490" watchObservedRunningTime="2026-06-14 20:19:14.879700064 +0000 UTC m=+71.749479494" Jun 14 20:19:17.606892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:17.606845 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:17.660932 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:17.660898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:19:26.973560 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.973434 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp"] Jun 14 20:19:26.977604 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.977581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:26.980496 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.980475 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 20:19:26.980496 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.980485 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 20:19:26.980602 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.980489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 20:19:26.981392 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.981377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 20:19:26.989277 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:26.989256 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp"] Jun 14 20:19:27.065274 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.065248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-tmp\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.065382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.065280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqts\" (UniqueName: \"kubernetes.io/projected/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-kube-api-access-ncqts\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.065382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.065362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.165899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.165873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-tmp\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.165994 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.165903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqts\" (UniqueName: \"kubernetes.io/projected/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-kube-api-access-ncqts\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.165994 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.165941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.166271 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.166253 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-tmp\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.168366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.168350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.174119 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.174098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqts\" (UniqueName: \"kubernetes.io/projected/91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9-kube-api-access-ncqts\") pod \"klusterlet-addon-workmgr-74648d4f4c-xkwzp\" (UID: \"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.287277 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.287226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:27.404979 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.404951 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp"] Jun 14 20:19:27.407893 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:19:27.407862 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bcf549_4b7b_43fd_a7f5_d9ca82fc95a9.slice/crio-0dc0e77eebb4a43b3a5dd9986a6fdcc80ed7903150d5510cbaf5cb6d43933bb6 WatchSource:0}: Error finding container 0dc0e77eebb4a43b3a5dd9986a6fdcc80ed7903150d5510cbaf5cb6d43933bb6: Status 404 returned error can't find the container with id 0dc0e77eebb4a43b3a5dd9986a6fdcc80ed7903150d5510cbaf5cb6d43933bb6 Jun 14 20:19:27.883052 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:27.883014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" event={"ID":"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9","Type":"ContainerStarted","Data":"0dc0e77eebb4a43b3a5dd9986a6fdcc80ed7903150d5510cbaf5cb6d43933bb6"} Jun 14 20:19:31.894518 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:31.894480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" event={"ID":"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9","Type":"ContainerStarted","Data":"f37fde9c373b6d41d7a897b1c3245e38bba6e79c86b28d48bdf0ff089540f5c7"} Jun 14 20:19:31.894974 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:31.894663 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:31.896140 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:31.896122 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:19:31.911797 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:31.911758 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" podStartSLOduration=2.317380001 podStartE2EDuration="5.911745627s" totalImagesPullingTime="3.594365626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:19:31.910998684 +0000 UTC m=+88.780778138" watchObservedRunningTime="2026-06-14 20:19:31.911745627 +0000 UTC m=+88.781525057" Jun 14 20:19:42.775902 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:42.775824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:19:42.776285 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:42.775936 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:19:42.776285 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:42.775946 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:19:42.776285 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:42.775993 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:20:46.775980876 +0000 UTC m=+163.645760285 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:19:42.876351 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:42.876311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:19:42.876457 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:42.876423 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:19:42.876496 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:19:42.876472 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:20:46.876460081 +0000 UTC m=+163.746239489 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:19:45.858083 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:19:45.858047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64cqb" Jun 14 20:20:13.286674 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:13.286640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:20:13.287178 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:13.286769 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 20:20:13.287178 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:13.286838 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs podName:07ad4325-7ff9-49a6-916b-0b44d777fd96 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:15.286819618 +0000 UTC m=+252.156599046 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs") pod "network-metrics-daemon-v6d4n" (UID: "07ad4325-7ff9-49a6-916b-0b44d777fd96") : secret "metrics-daemon-secret" not found Jun 14 20:20:42.026481 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:42.026439 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" Jun 14 20:20:42.038715 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:42.038692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ms2v6" podUID="2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5" Jun 14 20:20:42.054602 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:42.054578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:20:42.054602 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:42.054589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:20:43.511457 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:43.511420 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v6d4n" podUID="07ad4325-7ff9-49a6-916b-0b44d777fd96" Jun 14 20:20:46.821112 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:46.821067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:20:46.821504 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:46.821208 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 20:20:46.821504 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:46.821221 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6df6f86f6d-fbpch: secret "image-registry-tls" not found Jun 14 20:20:46.821504 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:46.821278 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls podName:97fe87e8-1a3f-487f-b360-118443d3cc6b nodeName:}" failed. No retries permitted until 2026-06-14 20:22:48.821265083 +0000 UTC m=+285.691044497 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls") pod "image-registry-6df6f86f6d-fbpch" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b") : secret "image-registry-tls" not found Jun 14 20:20:46.922384 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:46.922345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:20:46.922536 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:46.922452 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 20:20:46.922536 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:20:46.922507 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls podName:2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:48.922494954 +0000 UTC m=+285.792274364 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls") pod "dns-default-ms2v6" (UID: "2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5") : secret "dns-default-metrics-tls" not found Jun 14 20:20:58.493990 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:20:58.493896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:21:26.858576 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:26.858549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:31.168702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:31.168672 2576 generic.go:356] "Generic (PLEG): container finished" podID="91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9" containerID="f37fde9c373b6d41d7a897b1c3245e38bba6e79c86b28d48bdf0ff089540f5c7" exitCode=1 Jun 14 20:21:31.169052 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:31.168731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" event={"ID":"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9","Type":"ContainerDied","Data":"f37fde9c373b6d41d7a897b1c3245e38bba6e79c86b28d48bdf0ff089540f5c7"} Jun 14 20:21:31.169132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:31.169115 2576 scope.go:117] "RemoveContainer" containerID="f37fde9c373b6d41d7a897b1c3245e38bba6e79c86b28d48bdf0ff089540f5c7" Jun 14 20:21:31.895613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:31.895583 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:21:32.175674 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:32.175600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" event={"ID":"91bcf549-4b7b-43fd-a7f5-d9ca82fc95a9","Type":"ContainerStarted","Data":"16cb6166a3054fe472435a47f301502eb54e770f96701f7998914135cf1e5689"} Jun 14 20:21:32.176095 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:32.175798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:21:32.176441 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:32.176426 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74648d4f4c-xkwzp" Jun 14 20:21:52.338645 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.338606 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl"] Jun 14 20:21:52.340461 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.340446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.342651 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.342618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 20:21:52.342798 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.342665 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 20:21:52.342798 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.342674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:21:52.342798 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.342720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 20:21:52.343836 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.343813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4khlm\"" Jun 14 20:21:52.344951 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.344931 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-77rjc"] Jun 14 20:21:52.346767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.346747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.349207 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.349177 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 20:21:52.349296 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.349280 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 20:21:52.349357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.349295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 20:21:52.349586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.349573 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 20:21:52.349810 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.349795 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-26gfl\"" Jun 14 20:21:52.352118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.352098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl"] Jun 14 20:21:52.352236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.352095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e688020-223a-40a2-9296-3cdffc3a3bf3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.352236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.352223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e688020-223a-40a2-9296-3cdffc3a3bf3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.352344 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.352293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scdnx\" (UniqueName: \"kubernetes.io/projected/8e688020-223a-40a2-9296-3cdffc3a3bf3-kube-api-access-scdnx\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.355295 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.355274 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 20:21:52.360811 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.360793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-77rjc"] Jun 14 20:21:52.438613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.438590 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7"] Jun 14 20:21:52.440457 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.440443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.443257 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.443235 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 14 20:21:52.443357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.443269 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g5qx9\"" Jun 14 20:21:52.443357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.443295 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:21:52.443560 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.443544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 14 20:21:52.453559 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-snapshots\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453646 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.453646 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh77b\" (UniqueName: \"kubernetes.io/projected/a23e54a1-88d8-49f2-b58c-6de52aad2100-kube-api-access-xh77b\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453646 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23e54a1-88d8-49f2-b58c-6de52aad2100-serving-cert\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knngm\" (UniqueName: \"kubernetes.io/projected/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-kube-api-access-knngm\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.453761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scdnx\" (UniqueName: \"kubernetes.io/projected/8e688020-223a-40a2-9296-3cdffc3a3bf3-kube-api-access-scdnx\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.453903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-tmp\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.453903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e688020-223a-40a2-9296-3cdffc3a3bf3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.453903 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.453889 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e688020-223a-40a2-9296-3cdffc3a3bf3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.454486 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.454470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e688020-223a-40a2-9296-3cdffc3a3bf3-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.456093 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.456067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e688020-223a-40a2-9296-3cdffc3a3bf3-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.456215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.456107 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7"] Jun 14 20:21:52.473864 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.473845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scdnx\" (UniqueName: \"kubernetes.io/projected/8e688020-223a-40a2-9296-3cdffc3a3bf3-kube-api-access-scdnx\") pod \"kube-storage-version-migrator-operator-7c578b78fc-67xsl\" (UID: \"8e688020-223a-40a2-9296-3cdffc3a3bf3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.536237 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.536212 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7hwhs"] Jun 14 20:21:52.538318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.538303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.542701 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.542682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 20:21:52.542801 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.542719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6blbn\"" Jun 14 20:21:52.542801 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.542719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 20:21:52.545885 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.545866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7hwhs"] Jun 14 20:21:52.554565 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-snapshots\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.554648 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.554648 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh77b\" (UniqueName: \"kubernetes.io/projected/a23e54a1-88d8-49f2-b58c-6de52aad2100-kube-api-access-xh77b\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.554721 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:52.554661 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 20:21:52.554721 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:52.554699 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls podName:fa5595a4-1a39-42f3-bcda-b61c3ce46b99 nodeName:}" failed. No retries permitted until 2026-06-14 20:21:53.054686809 +0000 UTC m=+229.924466219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pcww7" (UID: "fa5595a4-1a39-42f3-bcda-b61c3ce46b99") : secret "samples-operator-tls" not found Jun 14 20:21:52.554721 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23e54a1-88d8-49f2-b58c-6de52aad2100-serving-cert\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.554873 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554739 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.554873 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knngm\" (UniqueName: \"kubernetes.io/projected/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-kube-api-access-knngm\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.554967 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1e49d3-868c-4282-8c38-ce64b286244c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.555020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.554968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-tmp\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.555076 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.555191 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.555282 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-snapshots\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.555381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a23e54a1-88d8-49f2-b58c-6de52aad2100-tmp\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.555666 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.555739 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.555670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a23e54a1-88d8-49f2-b58c-6de52aad2100-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.557157 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.557134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a23e54a1-88d8-49f2-b58c-6de52aad2100-serving-cert\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.562690 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.562672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh77b\" (UniqueName: \"kubernetes.io/projected/a23e54a1-88d8-49f2-b58c-6de52aad2100-kube-api-access-xh77b\") pod \"insights-operator-5bbd86d6bd-77rjc\" (UID: \"a23e54a1-88d8-49f2-b58c-6de52aad2100\") " pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.563237 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.563217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knngm\" (UniqueName: \"kubernetes.io/projected/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-kube-api-access-knngm\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:52.625542 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.625491 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:52.650597 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.650569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" Jun 14 20:21:52.656050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.656031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1e49d3-868c-4282-8c38-ce64b286244c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.656123 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.656085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.656225 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:52.656202 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:21:52.656274 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:52.656263 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:21:53.156248816 +0000 UTC m=+230.026028240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:21:52.656584 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.656569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5a1e49d3-868c-4282-8c38-ce64b286244c-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:52.658004 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.657986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" Jun 14 20:21:52.726317 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.726283 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:52.776459 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.776432 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl"] Jun 14 20:21:52.778472 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:21:52.778444 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e688020_223a_40a2_9296_3cdffc3a3bf3.slice/crio-9865fb2d9b017fd80388705f3e1437655f04fcfe4741acac66c34016d32da669 WatchSource:0}: Error finding container 9865fb2d9b017fd80388705f3e1437655f04fcfe4741acac66c34016d32da669: Status 404 returned error can't find the container with id 9865fb2d9b017fd80388705f3e1437655f04fcfe4741acac66c34016d32da669 Jun 14 20:21:52.789909 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:52.789888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-77rjc"] Jun 14 20:21:52.792306 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:21:52.792285 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23e54a1_88d8_49f2_b58c_6de52aad2100.slice/crio-34d6ac705fec1000aaa8de490a686cc0251dd5e0fd0de210bc4b04416fe1fcae WatchSource:0}: Error finding container 34d6ac705fec1000aaa8de490a686cc0251dd5e0fd0de210bc4b04416fe1fcae: Status 404 returned error can't find the container with id 34d6ac705fec1000aaa8de490a686cc0251dd5e0fd0de210bc4b04416fe1fcae Jun 14 20:21:53.058161 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:53.058117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:53.058307 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:53.058256 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 20:21:53.058352 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:53.058317 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls podName:fa5595a4-1a39-42f3-bcda-b61c3ce46b99 nodeName:}" failed. No retries permitted until 2026-06-14 20:21:54.058300554 +0000 UTC m=+230.928079962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pcww7" (UID: "fa5595a4-1a39-42f3-bcda-b61c3ce46b99") : secret "samples-operator-tls" not found Jun 14 20:21:53.159021 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:53.158994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:53.159165 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:53.159091 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:21:53.159165 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:53.159134 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:21:54.159122538 +0000 UTC m=+231.028901947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:21:53.235033 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:53.234999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" event={"ID":"a23e54a1-88d8-49f2-b58c-6de52aad2100","Type":"ContainerStarted","Data":"34d6ac705fec1000aaa8de490a686cc0251dd5e0fd0de210bc4b04416fe1fcae"} Jun 14 20:21:53.235972 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:53.235949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" event={"ID":"8e688020-223a-40a2-9296-3cdffc3a3bf3","Type":"ContainerStarted","Data":"9865fb2d9b017fd80388705f3e1437655f04fcfe4741acac66c34016d32da669"} Jun 14 20:21:54.067156 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:54.067121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:54.067521 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:54.067263 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 20:21:54.067521 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:54.067326 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls podName:fa5595a4-1a39-42f3-bcda-b61c3ce46b99 nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.06730928 +0000 UTC m=+232.937088690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pcww7" (UID: "fa5595a4-1a39-42f3-bcda-b61c3ce46b99") : secret "samples-operator-tls" not found Jun 14 20:21:54.168004 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:54.167945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:54.168184 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:54.168107 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:21:54.168246 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:54.168193 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.168172295 +0000 UTC m=+233.037951708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:21:55.061507 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.061453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:55.163306 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.163281 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:55.244329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.244299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" event={"ID":"a23e54a1-88d8-49f2-b58c-6de52aad2100","Type":"ContainerStarted","Data":"b63896c7c051d11ee0881f5b9a96c2b4c3007c95132e63a87ca1785129c48bc5"} Jun 14 20:21:55.245783 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.245737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" event={"ID":"8e688020-223a-40a2-9296-3cdffc3a3bf3","Type":"ContainerStarted","Data":"906f75775bb21b505fd91b68373f73fce06c95b23dac79a52b4cfe03cfc7132d"} Jun 14 20:21:55.263575 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.263530 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" podStartSLOduration=0.90249998 podStartE2EDuration="3.263514851s" totalImagesPullingTime="2.361014871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:21:55.261933623 +0000 UTC m=+232.131713079" watchObservedRunningTime="2026-06-14 20:21:55.263514851 +0000 UTC m=+232.133294281" Jun 14 20:21:55.276093 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.276051 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" podStartSLOduration=0.899527427 podStartE2EDuration="3.276035896s" totalImagesPullingTime="2.376508469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:21:55.275479639 +0000 UTC m=+232.145259071" watchObservedRunningTime="2026-06-14 20:21:55.276035896 +0000 UTC m=+232.145815327" Jun 14 20:21:55.991438 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.991398 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stztx"] Jun 14 20:21:55.993757 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.993732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:55.997882 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.997860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 20:21:55.998046 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.997911 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nr27v\"" Jun 14 20:21:55.998125 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:55.998106 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 20:21:56.010094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.010070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stztx"] Jun 14 20:21:56.039199 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.039170 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.086555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.086662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.086662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:21:56.086662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/943fec76-26ad-47a3-a927-51868d42d90e-crio-socket\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.086820 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.086671 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 20:21:56.086820 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smf6\" (UniqueName: \"kubernetes.io/projected/943fec76-26ad-47a3-a927-51868d42d90e-kube-api-access-8smf6\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.086820 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.086713 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls podName:fa5595a4-1a39-42f3-bcda-b61c3ce46b99 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:00.086700605 +0000 UTC m=+236.956480015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pcww7" (UID: "fa5595a4-1a39-42f3-bcda-b61c3ce46b99") : secret "samples-operator-tls" not found Jun 14 20:21:56.086820 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.086779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/943fec76-26ad-47a3-a927-51868d42d90e-data-volume\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.088934 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.088915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.187838 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.187814 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smf6\" (UniqueName: \"kubernetes.io/projected/943fec76-26ad-47a3-a927-51868d42d90e-kube-api-access-8smf6\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.187868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/943fec76-26ad-47a3-a927-51868d42d90e-data-volume\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.187920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.187942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.187972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.188016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/943fec76-26ad-47a3-a927-51868d42d90e-crio-socket\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188057 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.188115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/943fec76-26ad-47a3-a927-51868d42d90e-crio-socket\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188057 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188139 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188137 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:22:00.188118843 +0000 UTC m=+237.057898266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188227 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.688209309 +0000 UTC m=+233.557988723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.188242 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.188248 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:56.688237587 +0000 UTC m=+233.558016997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : configmap "kube-rbac-proxy" not found Jun 14 20:21:56.188783 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.188283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/943fec76-26ad-47a3-a927-51868d42d90e-data-volume\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.194804 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.194784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smf6\" (UniqueName: \"kubernetes.io/projected/943fec76-26ad-47a3-a927-51868d42d90e-kube-api-access-8smf6\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.529558 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.529516 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.547121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.547094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6"] Jun 14 20:21:56.549661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.549645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" Jun 14 20:21:56.552195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.552173 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 14 20:21:56.552195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.552196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ckpfv\"" Jun 14 20:21:56.552391 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.552216 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 14 20:21:56.560418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.560399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6"] Jun 14 20:21:56.591113 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.591087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7sv5\" (UniqueName: \"kubernetes.io/projected/ef1fad4c-2ba4-4536-8b69-822cd6351cc7-kube-api-access-l7sv5\") pod \"migrator-d4bcd4867-qmmh6\" (UID: \"ef1fad4c-2ba4-4536-8b69-822cd6351cc7\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" Jun 14 20:21:56.622986 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.622961 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.691382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.691356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7sv5\" (UniqueName: \"kubernetes.io/projected/ef1fad4c-2ba4-4536-8b69-822cd6351cc7-kube-api-access-l7sv5\") pod \"migrator-d4bcd4867-qmmh6\" (UID: \"ef1fad4c-2ba4-4536-8b69-822cd6351cc7\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" Jun 14 20:21:56.691487 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.691406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.691487 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.691431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:56.691588 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.691488 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:56.691588 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.691542 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:57.691527589 +0000 UTC m=+234.561307006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : configmap "kube-rbac-proxy" not found Jun 14 20:21:56.691693 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.691585 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.691693 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:56.691640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:57.691625656 +0000 UTC m=+234.561405066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:56.698770 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.698742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7sv5\" (UniqueName: \"kubernetes.io/projected/ef1fad4c-2ba4-4536-8b69-822cd6351cc7-kube-api-access-l7sv5\") pod \"migrator-d4bcd4867-qmmh6\" (UID: \"ef1fad4c-2ba4-4536-8b69-822cd6351cc7\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" Jun 14 20:21:56.719880 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.719854 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.819933 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.819904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:56.858882 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.858857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" Jun 14 20:21:56.976013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:56.975986 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6"] Jun 14 20:21:56.979658 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:21:56.979633 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1fad4c_2ba4_4536_8b69_822cd6351cc7.slice/crio-de3fef81348857323b09f56c5bc67e7050719fa7b285ad8c523a94ae9501c2cb WatchSource:0}: Error finding container de3fef81348857323b09f56c5bc67e7050719fa7b285ad8c523a94ae9501c2cb: Status 404 returned error can't find the container with id de3fef81348857323b09f56c5bc67e7050719fa7b285ad8c523a94ae9501c2cb Jun 14 20:21:57.180024 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.179950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:57.238056 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.238025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:57.252132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.252112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" event={"ID":"ef1fad4c-2ba4-4536-8b69-822cd6351cc7","Type":"ContainerStarted","Data":"de3fef81348857323b09f56c5bc67e7050719fa7b285ad8c523a94ae9501c2cb"} Jun 14 20:21:57.465430 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.465365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:57.563593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.563566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:57.697636 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.697604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:57.697793 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.697643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:57.697793 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:57.697739 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:57.697793 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:57.697763 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:57.697951 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:57.697802 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:59.697787116 +0000 UTC m=+236.567566525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : configmap "kube-rbac-proxy" not found Jun 14 20:21:57.697951 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:57.697817 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:21:59.697811007 +0000 UTC m=+236.567590417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:57.989399 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:57.989372 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrk6k_8b05a51a-4f76-43dd-9d3d-13ada924c188/dns-node-resolver/0.log" Jun 14 20:21:58.256432 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:58.256373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" event={"ID":"ef1fad4c-2ba4-4536-8b69-822cd6351cc7","Type":"ContainerStarted","Data":"fa752913a0968e7ee41e145a9c351a07dbea3a021c3c800c45d11862aeda7672"} Jun 14 20:21:58.256432 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:58.256425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" event={"ID":"ef1fad4c-2ba4-4536-8b69-822cd6351cc7","Type":"ContainerStarted","Data":"8f996c4589ff58c4d7e9b9420ed5f1b11f181a92fa7be26eae9741c7200bdf62"} Jun 14 20:21:58.271437 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:58.271395 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-qmmh6" podStartSLOduration=1.163711719 podStartE2EDuration="2.27138041s" totalImagesPullingTime="1.107668691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:21:58.270407282 +0000 UTC m=+235.140186712" watchObservedRunningTime="2026-06-14 20:21:58.27138041 +0000 UTC m=+235.141159856" Jun 14 20:21:58.373210 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:58.373172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:58.454197 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:58.454171 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:59.088505 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.088472 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:59.141456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.141417 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:21:59.189459 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.189439 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbwmz_777aa617-d758-4411-842e-4f8af4c0e336/node-ca/0.log" Jun 14 20:21:59.590526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.590504 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9hc7f_aea2eb77-e8ec-40e4-b060-6f64b7114c40/serve-healthcheck-canary/0.log" Jun 14 20:21:59.713785 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.713756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:59.713922 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.713790 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:21:59.713922 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:59.713870 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:21:59.713994 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:59.713923 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:22:03.713909925 +0000 UTC m=+240.583689334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : configmap "kube-rbac-proxy" not found Jun 14 20:21:59.713994 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:59.713941 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:21:59.713994 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:21:59.713978 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:22:03.713966922 +0000 UTC m=+240.583746336 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:21:59.925545 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:21:59.925468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:00.116448 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:00.116419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:22:00.116607 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:00.116566 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 14 20:22:00.116647 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:00.116637 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls podName:fa5595a4-1a39-42f3-bcda-b61c3ce46b99 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:08.116620655 +0000 UTC m=+244.986400092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls") pod "cluster-samples-operator-9547488fd-pcww7" (UID: "fa5595a4-1a39-42f3-bcda-b61c3ce46b99") : secret "samples-operator-tls" not found Jun 14 20:22:00.217503 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:00.217431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:22:00.217629 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:00.217573 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:22:00.217666 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:00.217632 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:22:08.217614887 +0000 UTC m=+245.087394297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:22:02.141692 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:02.141659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:02.871896 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:02.871867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:03.041774 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.041745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:03.153178 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.153082 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:03.204413 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.204380 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:03.744561 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.744531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:03.744561 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.744563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:03.744804 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:03.744647 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:22:03.744804 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:03.744658 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 20:22:03.744804 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:03.744695 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:22:11.744682617 +0000 UTC m=+248.614462026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:22:03.744804 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:03.744712 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:22:11.744703092 +0000 UTC m=+248.614482500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : configmap "kube-rbac-proxy" not found Jun 14 20:22:03.971414 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:03.971384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:04.163233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:04.163202 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:04.763077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:04.763045 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:05.169995 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:05.169964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:05.373636 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:05.373609 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:05.964624 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:05.964595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:06.161971 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:06.161943 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:06.484189 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:06.484141 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:06.763792 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:06.763712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:06.816979 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:06.816950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:07.174010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:07.173978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:07.375828 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:07.375799 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:07.966209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:07.966172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:08.163721 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.163692 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:08.181748 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.181727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:22:08.184122 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.184102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa5595a4-1a39-42f3-bcda-b61c3ce46b99-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-pcww7\" (UID: \"fa5595a4-1a39-42f3-bcda-b61c3ce46b99\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:22:08.283035 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.282949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:22:08.283193 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:08.283110 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 20:22:08.283245 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:08.283203 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert podName:5a1e49d3-868c-4282-8c38-ce64b286244c nodeName:}" failed. No retries permitted until 2026-06-14 20:22:24.283187586 +0000 UTC m=+261.152966999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7hwhs" (UID: "5a1e49d3-868c-4282-8c38-ce64b286244c") : secret "networking-console-plugin-cert" not found Jun 14 20:22:08.352040 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.352006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-g5qx9\"" Jun 14 20:22:08.360046 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.360028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" Jun 14 20:22:08.483113 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.483091 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7"] Jun 14 20:22:08.564700 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:08.564662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:09.147663 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.147630 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:09.292191 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.292158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" event={"ID":"fa5595a4-1a39-42f3-bcda-b61c3ce46b99","Type":"ContainerStarted","Data":"57579625b62e54f6b2e8718ecb203bbbfa7a981f6b83f434c19aeee1c2d6c422"} Jun 14 20:22:09.367372 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.367317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:09.412708 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.412611 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:09.567239 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.567208 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:09.766314 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:09.766205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:10.163778 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:10.163746 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:10.296613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:10.296585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" event={"ID":"fa5595a4-1a39-42f3-bcda-b61c3ce46b99","Type":"ContainerStarted","Data":"8c4c3d148af0bf30b2bad8b4388bd44d14807c094fb5d3443ecde943744e02d4"} Jun 14 20:22:10.296763 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:10.296644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" event={"ID":"fa5595a4-1a39-42f3-bcda-b61c3ce46b99","Type":"ContainerStarted","Data":"fbcc406a98e0439c2f2f8c9b4b4cf603ad75f036d03a81606dda3b7036cae895"} Jun 14 20:22:10.312740 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:10.312697 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-pcww7" podStartSLOduration=16.830365825 podStartE2EDuration="18.312686727s" totalImagesPullingTime="1.482320902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:10.311560283 +0000 UTC m=+247.181339713" watchObservedRunningTime="2026-06-14 20:22:10.312686727 +0000 UTC m=+247.182466157" Jun 14 20:22:10.963395 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:10.963336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:11.361059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.361024 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:11.531368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.531332 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:11.630001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.629941 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:11.763400 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.763369 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:11.814656 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.814628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:11.814784 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.814659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:11.814784 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:11.814756 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 20:22:11.814849 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:11.814805 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls podName:943fec76-26ad-47a3-a927-51868d42d90e nodeName:}" failed. No retries permitted until 2026-06-14 20:22:27.814793088 +0000 UTC m=+264.684572498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stztx" (UID: "943fec76-26ad-47a3-a927-51868d42d90e") : secret "insights-runtime-extractor-tls" not found Jun 14 20:22:11.815100 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.815081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/943fec76-26ad-47a3-a927-51868d42d90e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:11.964267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:11.964172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:12.966193 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:12.966137 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:13.233925 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:13.233856 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:13.363548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:13.363517 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:13.568021 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:13.567966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:15.344596 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.344568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:22:15.346765 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.346746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07ad4325-7ff9-49a6-916b-0b44d777fd96-metrics-certs\") pod \"network-metrics-daemon-v6d4n\" (UID: \"07ad4325-7ff9-49a6-916b-0b44d777fd96\") " pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:22:15.597451 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.597391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7cfxq\"" Jun 14 20:22:15.605424 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.605404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v6d4n" Jun 14 20:22:15.682745 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.682697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:15.723928 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.723844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v6d4n"] Jun 14 20:22:15.725844 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:15.725817 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ad4325_7ff9_49a6_916b_0b44d777fd96.slice/crio-d8333e1a8a59d464144ff9aef1111acc8b7cc682f32cbc5e9a609a0d5ff9b8ec WatchSource:0}: Error finding container d8333e1a8a59d464144ff9aef1111acc8b7cc682f32cbc5e9a609a0d5ff9b8ec: Status 404 returned error can't find the container with id d8333e1a8a59d464144ff9aef1111acc8b7cc682f32cbc5e9a609a0d5ff9b8ec Jun 14 20:22:15.793092 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:15.793058 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:16.314951 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:16.314919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6d4n" event={"ID":"07ad4325-7ff9-49a6-916b-0b44d777fd96","Type":"ContainerStarted","Data":"d8333e1a8a59d464144ff9aef1111acc8b7cc682f32cbc5e9a609a0d5ff9b8ec"} Jun 14 20:22:17.320968 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.320941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6d4n" event={"ID":"07ad4325-7ff9-49a6-916b-0b44d777fd96","Type":"ContainerStarted","Data":"ace5efe600f299fd85c6c365e2ae0abbb1139b64b700c12419a68758491eddd7"} Jun 14 20:22:17.321339 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.320995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v6d4n" event={"ID":"07ad4325-7ff9-49a6-916b-0b44d777fd96","Type":"ContainerStarted","Data":"031f84f7eb86b6ca6b3c98db8ee71fb8a4b121f01169cecddf727753acb6e2ee"} Jun 14 20:22:17.338048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.338003 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v6d4n" podStartSLOduration=253.118337333 podStartE2EDuration="4m14.337978818s" totalImagesPullingTime="1.219641485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:17.336232843 +0000 UTC m=+254.206012273" watchObservedRunningTime="2026-06-14 20:22:17.337978818 +0000 UTC m=+254.207758249" Jun 14 20:22:17.817823 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.817792 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:17.885477 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.885445 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:17.986975 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:17.986950 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:18.558354 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:18.558326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:18.608435 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:18.608407 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:24.311292 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:24.311213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:22:24.313478 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:24.313454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5a1e49d3-868c-4282-8c38-ce64b286244c-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7hwhs\" (UID: \"5a1e49d3-868c-4282-8c38-ce64b286244c\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:22:24.353666 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:24.353641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6blbn\"" Jun 14 20:22:24.361721 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:24.361701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" Jun 14 20:22:24.480220 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:24.480195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7hwhs"] Jun 14 20:22:24.482520 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:24.482497 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1e49d3_868c_4282_8c38_ce64b286244c.slice/crio-c723b0d0c9d3a60fe5dbfb2a125dfd8970036e9314c1ae3c94bf316adc034a63 WatchSource:0}: Error finding container c723b0d0c9d3a60fe5dbfb2a125dfd8970036e9314c1ae3c94bf316adc034a63: Status 404 returned error can't find the container with id c723b0d0c9d3a60fe5dbfb2a125dfd8970036e9314c1ae3c94bf316adc034a63 Jun 14 20:22:25.347382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:25.347337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" event={"ID":"5a1e49d3-868c-4282-8c38-ce64b286244c","Type":"ContainerStarted","Data":"c723b0d0c9d3a60fe5dbfb2a125dfd8970036e9314c1ae3c94bf316adc034a63"} Jun 14 20:22:25.495723 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:25.495643 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:25.547256 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:25.547226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.351719 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.351681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" event={"ID":"5a1e49d3-868c-4282-8c38-ce64b286244c","Type":"ContainerStarted","Data":"611de59ce063b40ef3914b74e8911b3120938c3a20d5e2d6e7e07566e26591ba"} Jun 14 20:22:26.366753 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.366708 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-7hwhs" podStartSLOduration=33.262069917 podStartE2EDuration="34.366693771s" totalImagesPullingTime="1.104623854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:26.365453971 +0000 UTC m=+263.235233402" watchObservedRunningTime="2026-06-14 20:22:26.366693771 +0000 UTC m=+263.236473202" Jun 14 20:22:26.454785 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.454759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.556088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.556054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.659113 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.659054 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.759959 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.759937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.813389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.813361 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4"] Jun 14 20:22:26.816553 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.816539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:26.818803 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.818784 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 14 20:22:26.818914 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.818829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9n6ss\"" Jun 14 20:22:26.823416 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.823395 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4"] Jun 14 20:22:26.828653 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.828632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.908126 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.908097 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:26.929443 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:26.929393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad864df5-fce2-44b0-a9cf-04ca95e81249-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-gzlf4\" (UID: \"ad864df5-fce2-44b0-a9cf-04ca95e81249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:27.030674 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.030640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad864df5-fce2-44b0-a9cf-04ca95e81249-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-gzlf4\" (UID: \"ad864df5-fce2-44b0-a9cf-04ca95e81249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:27.032944 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.032921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad864df5-fce2-44b0-a9cf-04ca95e81249-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-gzlf4\" (UID: \"ad864df5-fce2-44b0-a9cf-04ca95e81249\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:27.125045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.125024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:27.243730 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.243699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4"] Jun 14 20:22:27.246459 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:27.246432 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad864df5_fce2_44b0_a9cf_04ca95e81249.slice/crio-e9d7003ed47e0578066d2ac07284cce0c3fdcb529bc428c79e2f3b7cfcfd1b37 WatchSource:0}: Error finding container e9d7003ed47e0578066d2ac07284cce0c3fdcb529bc428c79e2f3b7cfcfd1b37: Status 404 returned error can't find the container with id e9d7003ed47e0578066d2ac07284cce0c3fdcb529bc428c79e2f3b7cfcfd1b37 Jun 14 20:22:27.356234 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.356202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" event={"ID":"ad864df5-fce2-44b0-a9cf-04ca95e81249","Type":"ContainerStarted","Data":"e9d7003ed47e0578066d2ac07284cce0c3fdcb529bc428c79e2f3b7cfcfd1b37"} Jun 14 20:22:27.837015 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.836970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:27.839378 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:27.839346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/943fec76-26ad-47a3-a927-51868d42d90e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stztx\" (UID: \"943fec76-26ad-47a3-a927-51868d42d90e\") " pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:28.106512 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:28.106424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nr27v\"" Jun 14 20:22:28.114499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:28.114473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stztx" Jun 14 20:22:28.250802 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:28.250750 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stztx"] Jun 14 20:22:28.408815 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:28.408742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943fec76_26ad_47a3_a927_51868d42d90e.slice/crio-edb7cad964b61c43cb821ada64b99f7b21f687e9244d8fbaa7bc893cf626d2d2 WatchSource:0}: Error finding container edb7cad964b61c43cb821ada64b99f7b21f687e9244d8fbaa7bc893cf626d2d2: Status 404 returned error can't find the container with id edb7cad964b61c43cb821ada64b99f7b21f687e9244d8fbaa7bc893cf626d2d2 Jun 14 20:22:29.187985 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.187925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:29.246479 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.246449 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:29.365208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.365091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" event={"ID":"ad864df5-fce2-44b0-a9cf-04ca95e81249","Type":"ContainerStarted","Data":"2483eba2275c5bc548e241f75c7153d9f3f8d01431672ebb0aed64fbcf685687"} Jun 14 20:22:29.365208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.365168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:29.366655 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.366626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stztx" event={"ID":"943fec76-26ad-47a3-a927-51868d42d90e","Type":"ContainerStarted","Data":"edb7cad964b61c43cb821ada64b99f7b21f687e9244d8fbaa7bc893cf626d2d2"} Jun 14 20:22:29.370768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.370745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" Jun 14 20:22:29.380535 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.380487 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-gzlf4" podStartSLOduration=2.176333843 podStartE2EDuration="3.380469385s" totalImagesPullingTime="1.204135542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:29.379356214 +0000 UTC m=+266.249135667" watchObservedRunningTime="2026-06-14 20:22:29.380469385 +0000 UTC m=+266.250248817" Jun 14 20:22:29.836644 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.836610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:29.903961 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.903922 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:29.992660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:29.992629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:32.378892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:32.378861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stztx" event={"ID":"943fec76-26ad-47a3-a927-51868d42d90e","Type":"ContainerStarted","Data":"78c1633f9555862eb97126f1efce8601da0b8f40855f50a2a992900e1a1eab48"} Jun 14 20:22:33.384809 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:33.384770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stztx" event={"ID":"943fec76-26ad-47a3-a927-51868d42d90e","Type":"ContainerStarted","Data":"b7d22ee7087b1af9fda9b4b9d12136824223e012d4d5b230875369c69f598427"} Jun 14 20:22:33.397838 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:33.397808 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:34.389591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:34.389562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stztx" event={"ID":"943fec76-26ad-47a3-a927-51868d42d90e","Type":"ContainerStarted","Data":"d4d4a8a29a0df2cd2d45adca88380a15345b607e259afcff6906cb1b1a283927"} Jun 14 20:22:35.956504 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:35.956468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.056700 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.056671 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.165757 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.165734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.188628 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.188581 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stztx" podStartSLOduration=35.778456383 podStartE2EDuration="41.188563039s" totalImagesPullingTime="5.410106656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:21:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:34.407291216 +0000 UTC m=+271.277070680" watchObservedRunningTime="2026-06-14 20:22:36.188563039 +0000 UTC m=+273.058342471" Jun 14 20:22:36.189714 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.189691 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8g97"] Jun 14 20:22:36.192961 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.192944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.196605 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196541 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 20:22:36.196605 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196553 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 20:22:36.196605 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 20:22:36.196791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 20:22:36.196791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 20:22:36.196791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d5677\"" Jun 14 20:22:36.196927 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.196878 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 20:22:36.202751 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.202734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8g97"] Jun 14 20:22:36.215502 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.215451 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-scpqj"] Jun 14 20:22:36.218563 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.218544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.220912 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.220891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 20:22:36.221010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.220910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 20:22:36.221010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.220983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v6w2h\"" Jun 14 20:22:36.221010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.220988 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 20:22:36.240792 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.240770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.296335 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.296421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.296421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.296421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.296521 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6mcv\" (UniqueName: \"kubernetes.io/projected/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-api-access-p6mcv\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.296521 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.296484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d88d093-1b03-407c-b799-0dd2e40411dc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.396800 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.396893 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-wtmp\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.396893 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-accelerators-collector-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.396893 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.396893 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzdft\" (UniqueName: \"kubernetes.io/projected/879931c6-51e7-4a64-8b6e-971d7526c846-kube-api-access-mzdft\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397024 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:36.396938 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 20:22:36.397024 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.396980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-root\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397024 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:36.396994 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls podName:9d88d093-1b03-407c-b799-0dd2e40411dc nodeName:}" failed. No retries permitted until 2026-06-14 20:22:36.896976382 +0000 UTC m=+273.766755804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-f8g97" (UID: "9d88d093-1b03-407c-b799-0dd2e40411dc") : secret "kube-state-metrics-tls" not found Jun 14 20:22:36.397121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397038 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6mcv\" (UniqueName: \"kubernetes.io/projected/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-api-access-p6mcv\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d88d093-1b03-407c-b799-0dd2e40411dc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-metrics-client-ca\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-sys\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397458 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-textfile\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397458 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.397558 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9d88d093-1b03-407c-b799-0dd2e40411dc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397635 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.397741 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.397662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d88d093-1b03-407c-b799-0dd2e40411dc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.399435 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.399417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.404581 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.404563 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6mcv\" (UniqueName: \"kubernetes.io/projected/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-api-access-p6mcv\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.497664 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497664 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-metrics-client-ca\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497664 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-sys\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497870 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-textfile\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497870 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-sys\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497870 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.497870 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-wtmp\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-accelerators-collector-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzdft\" (UniqueName: \"kubernetes.io/projected/879931c6-51e7-4a64-8b6e-971d7526c846-kube-api-access-mzdft\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-textfile\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:36.497922 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-root\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.497979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-wtmp\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:36.497986 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls podName:879931c6-51e7-4a64-8b6e-971d7526c846 nodeName:}" failed. No retries permitted until 2026-06-14 20:22:36.997968073 +0000 UTC m=+273.867747483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls") pod "node-exporter-scpqj" (UID: "879931c6-51e7-4a64-8b6e-971d7526c846") : secret "node-exporter-tls" not found Jun 14 20:22:36.498071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.498013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/879931c6-51e7-4a64-8b6e-971d7526c846-root\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498425 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.498266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-metrics-client-ca\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.498425 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.498371 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-accelerators-collector-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.499709 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.499690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.508328 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.508310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzdft\" (UniqueName: \"kubernetes.io/projected/879931c6-51e7-4a64-8b6e-971d7526c846-kube-api-access-mzdft\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:36.510310 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.510286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.611791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.611754 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.711172 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.711133 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.810263 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.810234 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:36.901688 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.901652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.903936 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.903910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d88d093-1b03-407c-b799-0dd2e40411dc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8g97\" (UID: \"9d88d093-1b03-407c-b799-0dd2e40411dc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:36.910238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:36.910218 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:37.002214 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.002190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:37.004261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.004239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/879931c6-51e7-4a64-8b6e-971d7526c846-node-exporter-tls\") pod \"node-exporter-scpqj\" (UID: \"879931c6-51e7-4a64-8b6e-971d7526c846\") " pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:37.102390 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.102334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" Jun 14 20:22:37.130156 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.130132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-scpqj" Jun 14 20:22:37.144006 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:37.143983 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879931c6_51e7_4a64_8b6e_971d7526c846.slice/crio-2439183fe82621fccdcac077ed6df28bff8821f3823c36071221185f2b202cbb WatchSource:0}: Error finding container 2439183fe82621fccdcac077ed6df28bff8821f3823c36071221185f2b202cbb: Status 404 returned error can't find the container with id 2439183fe82621fccdcac077ed6df28bff8821f3823c36071221185f2b202cbb Jun 14 20:22:37.168477 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.168453 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:37.232686 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.232660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8g97"] Jun 14 20:22:37.235324 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:37.235294 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d88d093_1b03_407c_b799_0dd2e40411dc.slice/crio-a7dc8d77efcef6cab0c196bdee86c278215a1a44ffc3821fb5dea504ed570581 WatchSource:0}: Error finding container a7dc8d77efcef6cab0c196bdee86c278215a1a44ffc3821fb5dea504ed570581: Status 404 returned error can't find the container with id a7dc8d77efcef6cab0c196bdee86c278215a1a44ffc3821fb5dea504ed570581 Jun 14 20:22:37.258010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.257983 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:22:37.262774 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.262757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265226 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265267 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265277 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g2w22\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265302 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 20:22:37.265418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 20:22:37.265775 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265677 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 20:22:37.265775 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.265694 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 20:22:37.266793 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.266768 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:37.279075 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.279054 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:22:37.400305 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.400230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scpqj" event={"ID":"879931c6-51e7-4a64-8b6e-971d7526c846","Type":"ContainerStarted","Data":"2439183fe82621fccdcac077ed6df28bff8821f3823c36071221185f2b202cbb"} Jun 14 20:22:37.401274 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.401251 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" event={"ID":"9d88d093-1b03-407c-b799-0dd2e40411dc","Type":"ContainerStarted","Data":"a7dc8d77efcef6cab0c196bdee86c278215a1a44ffc3821fb5dea504ed570581"} Jun 14 20:22:37.405597 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405728 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405758 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405827 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405827 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405886 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405886 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhmf2\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405886 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405971 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.405971 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.405923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506519 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhmf2\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.506910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.506831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.507564 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.507545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509182 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.507986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509349 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.508284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509639 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.509613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509780 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.509757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509851 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.509816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.509918 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.509872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.510013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.509995 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.510518 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.510498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.510710 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.510691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.511256 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.511238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.511728 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.511711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.515519 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.515499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhmf2\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2\") pod \"alertmanager-main-0\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.570427 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.570404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:37.572333 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.572308 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:22:37.707796 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:37.707755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:22:37.710884 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:37.710861 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0656a5e8_a23d_4ccb_95b2_018fc19b489f.slice/crio-d2b639c27af273d868e7b29d93fe69cd9fef0e03754f76934df9176fc1f7d584 WatchSource:0}: Error finding container d2b639c27af273d868e7b29d93fe69cd9fef0e03754f76934df9176fc1f7d584: Status 404 returned error can't find the container with id d2b639c27af273d868e7b29d93fe69cd9fef0e03754f76934df9176fc1f7d584 Jun 14 20:22:38.407342 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:38.407267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"d2b639c27af273d868e7b29d93fe69cd9fef0e03754f76934df9176fc1f7d584"} Jun 14 20:22:39.110065 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.110026 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:39.188490 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.188458 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6495bbc746-4z8rm"] Jun 14 20:22:39.190278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.190249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:39.192202 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.192186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.194884 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.194851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 20:22:39.194976 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.194930 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n8h29\"" Jun 14 20:22:39.194976 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.194948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 20:22:39.194976 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.194968 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3at1dnj6tauf0\"" Jun 14 20:22:39.195231 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.195214 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 20:22:39.195333 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.195236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 20:22:39.195768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.195749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 20:22:39.205539 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.205508 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6495bbc746-4z8rm"] Jun 14 20:22:39.322071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-grpc-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322397 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322397 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79652633-5d09-4849-ad3f-dbec96e7ee96-metrics-client-ca\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.322397 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.322355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4wm\" (UniqueName: \"kubernetes.io/projected/79652633-5d09-4849-ad3f-dbec96e7ee96-kube-api-access-tl4wm\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.413021 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.412989 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" event={"ID":"9d88d093-1b03-407c-b799-0dd2e40411dc","Type":"ContainerStarted","Data":"5bc439611f1caaab277f91251b4d7239e7afc6244f57ecb6eeccd2ab533ca467"} Jun 14 20:22:39.413433 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.413062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" event={"ID":"9d88d093-1b03-407c-b799-0dd2e40411dc","Type":"ContainerStarted","Data":"30e446ccc5f5e0363e5860700944a6171a230673930d713a05b9dd550ea78fa6"} Jun 14 20:22:39.413433 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.413093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" event={"ID":"9d88d093-1b03-407c-b799-0dd2e40411dc","Type":"ContainerStarted","Data":"9947ff0cd9cb7bd6044ad588505bd95368195adb3334f445e91aa8ed50d89731"} Jun 14 20:22:39.414613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.414591 2576 generic.go:356] "Generic (PLEG): container finished" podID="879931c6-51e7-4a64-8b6e-971d7526c846" containerID="1abbf2e63f5e97199670b16b4afe23fe5af6f4769502a8d0b2004dc17f7fefde" exitCode=0 Jun 14 20:22:39.414689 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.414660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scpqj" event={"ID":"879931c6-51e7-4a64-8b6e-971d7526c846","Type":"ContainerDied","Data":"1abbf2e63f5e97199670b16b4afe23fe5af6f4769502a8d0b2004dc17f7fefde"} Jun 14 20:22:39.416184 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.416158 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3" exitCode=0 Jun 14 20:22:39.416272 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.416182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3"} Jun 14 20:22:39.422896 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.422874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.422965 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.422929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79652633-5d09-4849-ad3f-dbec96e7ee96-metrics-client-ca\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.422965 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.422956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4wm\" (UniqueName: \"kubernetes.io/projected/79652633-5d09-4849-ad3f-dbec96e7ee96-kube-api-access-tl4wm\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423117 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.422995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-grpc-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423117 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.423033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423241 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.423190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423297 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.423251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423890 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.423349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.423890 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.423760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79652633-5d09-4849-ad3f-dbec96e7ee96-metrics-client-ca\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.425849 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.425825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.426287 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.426265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.426385 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.426360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.426827 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.426806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.426879 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.426824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-grpc-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.427624 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.427602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/79652633-5d09-4849-ad3f-dbec96e7ee96-secret-thanos-querier-tls\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.430628 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.430585 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8g97" podStartSLOduration=1.8856896939999999 podStartE2EDuration="3.430567764s" totalImagesPullingTime="1.54487807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:39.429461699 +0000 UTC m=+276.299241181" watchObservedRunningTime="2026-06-14 20:22:39.430567764 +0000 UTC m=+276.300347196" Jun 14 20:22:39.432864 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.432842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4wm\" (UniqueName: \"kubernetes.io/projected/79652633-5d09-4849-ad3f-dbec96e7ee96-kube-api-access-tl4wm\") pod \"thanos-querier-6495bbc746-4z8rm\" (UID: \"79652633-5d09-4849-ad3f-dbec96e7ee96\") " pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.454352 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.454326 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:39.507602 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.507579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:39.643193 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.643156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6495bbc746-4z8rm"] Jun 14 20:22:39.645158 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:39.645110 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79652633_5d09_4849_ad3f_dbec96e7ee96.slice/crio-c3c387c3eefe470a73e33735953d7f1ebc0da409e83a8a86764aa2de1fe8e80e WatchSource:0}: Error finding container c3c387c3eefe470a73e33735953d7f1ebc0da409e83a8a86764aa2de1fe8e80e: Status 404 returned error can't find the container with id c3c387c3eefe470a73e33735953d7f1ebc0da409e83a8a86764aa2de1fe8e80e Jun 14 20:22:39.645472 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:39.645452 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:40.423267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:40.423165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scpqj" event={"ID":"879931c6-51e7-4a64-8b6e-971d7526c846","Type":"ContainerStarted","Data":"185f7a3c3f64021274100dc133a95107f01615ed039f382241f0559cb4b7b9de"} Jun 14 20:22:40.423267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:40.423230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-scpqj" event={"ID":"879931c6-51e7-4a64-8b6e-971d7526c846","Type":"ContainerStarted","Data":"8e6e39d20a78782b774a554d65134c44e4ed524db6cd35e44157233c5f9ea8d2"} Jun 14 20:22:40.424805 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:40.424773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"c3c387c3eefe470a73e33735953d7f1ebc0da409e83a8a86764aa2de1fe8e80e"} Jun 14 20:22:40.443825 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:40.443670 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-scpqj" podStartSLOduration=3.02678711 podStartE2EDuration="4.443650791s" totalImagesPullingTime="1.346402618s" totalInitContainerRuntime="70.461063ms" isStatefulPod=true podCreationTimestamp="2026-06-14 20:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:40.441039886 +0000 UTC m=+277.310819366" watchObservedRunningTime="2026-06-14 20:22:40.443650791 +0000 UTC m=+277.313430225" Jun 14 20:22:40.964306 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:40.964269 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:41.015118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:41.015075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:41.432216 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:41.432181 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359"} Jun 14 20:22:41.432610 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:41.432265 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26"} Jun 14 20:22:42.372757 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.372727 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:42.440946 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.440911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a"} Jun 14 20:22:42.441441 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.441030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619"} Jun 14 20:22:42.441441 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.441074 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3"} Jun 14 20:22:42.443869 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.443780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"d335352e7a45ffa7518b5649e94d16cb7a424d72040dd9ce4e52235b31048918"} Jun 14 20:22:42.443869 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.443851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"305664d422cc3e8e774ffbb5473bff1ec585f35f6106aff61f1f30a94030e338"} Jun 14 20:22:42.444042 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:42.443891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"391e1473ec319c9fe66039b86904d0a04d1f908f18bacd9b737c8d8cbe716b1d"} Jun 14 20:22:43.452619 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.452585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerStarted","Data":"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189"} Jun 14 20:22:43.455491 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.455466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"d969b6775a0f7be66749290b68ef4e673af5ccb4b363084763c999a50cbb9939"} Jun 14 20:22:43.455622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.455539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"d2a4aeaccaaaa59aeaf25c2d28a9b74118395862f78c815828fcdcd3b8c0174f"} Jun 14 20:22:43.455622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.455567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" event={"ID":"79652633-5d09-4849-ad3f-dbec96e7ee96","Type":"ContainerStarted","Data":"5bc706cb98d60ae6e00bacf69ab77a832a32b48271f5d33b8bc0620b4683faf6"} Jun 14 20:22:43.455622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.455594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:43.480917 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.480869 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.89319566 podStartE2EDuration="6.480856709s" totalImagesPullingTime="3.568475873s" totalInitContainerRuntime="19.185176ms" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:43.479569786 +0000 UTC m=+280.349349217" watchObservedRunningTime="2026-06-14 20:22:43.480856709 +0000 UTC m=+280.350636140" Jun 14 20:22:43.512109 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:43.512065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" podStartSLOduration=1.6623424770000002 podStartE2EDuration="4.512051274s" totalImagesPullingTime="2.849708797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:22:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:43.509498402 +0000 UTC m=+280.379277834" watchObservedRunningTime="2026-06-14 20:22:43.512051274 +0000 UTC m=+280.381830704" Jun 14 20:22:45.056004 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:45.055958 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ms2v6" podUID="2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5" Jun 14 20:22:45.056004 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:22:45.055964 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" Jun 14 20:22:45.463318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:45.463240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:22:45.463445 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:45.463240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:22:48.905215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:48.905171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:22:48.907505 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:48.907485 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"image-registry-6df6f86f6d-fbpch\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:22:49.006468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.006437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:22:49.008615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.008594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5-metrics-tls\") pod \"dns-default-ms2v6\" (UID: \"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5\") " pod="openshift-dns/dns-default-ms2v6" Jun 14 20:22:49.067810 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.067789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dldwt\"" Jun 14 20:22:49.067810 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.067801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qhwh9\"" Jun 14 20:22:49.074938 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.074917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:22:49.075038 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.075018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:22:49.218880 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.218851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:22:49.221264 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:49.221235 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fe87e8_1a3f_487f_b360_118443d3cc6b.slice/crio-76fd639920129609027caebe07f896a2524931063d6110101a512769331d16b3 WatchSource:0}: Error finding container 76fd639920129609027caebe07f896a2524931063d6110101a512769331d16b3: Status 404 returned error can't find the container with id 76fd639920129609027caebe07f896a2524931063d6110101a512769331d16b3 Jun 14 20:22:49.230105 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.230083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ms2v6"] Jun 14 20:22:49.233935 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:22:49.233918 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2b5dc8_04a9_4fb3_8a9c_2af6c8f3abd5.slice/crio-d368a98147e03cfeacff0308ada570e76e60915747144a73d35a8191a557efc8 WatchSource:0}: Error finding container d368a98147e03cfeacff0308ada570e76e60915747144a73d35a8191a557efc8: Status 404 returned error can't find the container with id d368a98147e03cfeacff0308ada570e76e60915747144a73d35a8191a557efc8 Jun 14 20:22:49.465204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.465106 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6495bbc746-4z8rm" Jun 14 20:22:49.480013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.479982 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms2v6" event={"ID":"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5","Type":"ContainerStarted","Data":"d368a98147e03cfeacff0308ada570e76e60915747144a73d35a8191a557efc8"} Jun 14 20:22:49.481434 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.481410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" event={"ID":"97fe87e8-1a3f-487f-b360-118443d3cc6b","Type":"ContainerStarted","Data":"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353"} Jun 14 20:22:49.481540 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.481444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" event={"ID":"97fe87e8-1a3f-487f-b360-118443d3cc6b","Type":"ContainerStarted","Data":"76fd639920129609027caebe07f896a2524931063d6110101a512769331d16b3"} Jun 14 20:22:49.481540 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.481523 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:22:49.503543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.503487 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" podStartSLOduration=285.503466248 podStartE2EDuration="4m45.503466248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:49.502276191 +0000 UTC m=+286.372055674" watchObservedRunningTime="2026-06-14 20:22:49.503466248 +0000 UTC m=+286.373245682" Jun 14 20:22:49.746121 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.746039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:49.846667 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.846636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:49.948327 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:49.948288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.045159 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.045119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.437219 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.437119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.537731 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.537700 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.637977 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.637930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.692920 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.692850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.805991 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.805945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:50.856598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:50.856566 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:51.215248 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.215226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:51.415927 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.415853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:51.491119 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.491092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms2v6" event={"ID":"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5","Type":"ContainerStarted","Data":"0d52a0436d335d0968259f5547707b48f43f87511d7344edf073a17da163e6b0"} Jun 14 20:22:51.491260 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.491183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ms2v6" event={"ID":"2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5","Type":"ContainerStarted","Data":"4200d2235ea98cceee593a331091aee1362885d32b22334b3f257da8dba9a882"} Jun 14 20:22:51.491260 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.491208 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:22:51.510530 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:51.510491 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ms2v6" podStartSLOduration=250.617142854 podStartE2EDuration="4m12.510477686s" totalImagesPullingTime="1.893334832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:18:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:22:51.508570651 +0000 UTC m=+288.378350082" watchObservedRunningTime="2026-06-14 20:22:51.510477686 +0000 UTC m=+288.380257117" Jun 14 20:22:52.419008 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:52.418978 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:52.835357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:52.835322 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:52.903748 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:52.903721 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:56.116313 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:56.116276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:22:56.162826 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:22:56.162800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:01.497768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:01.497738 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ms2v6" Jun 14 20:23:03.036196 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.036163 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:03.460126 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.460098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:23:03.460327 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.460170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:23:03.469218 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.469190 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 20:23:03.570380 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.570355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:03.617940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:03.617916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:05.431188 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:05.431136 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:06.424050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.424018 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:06.553117 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.553085 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e688020-223a-40a2-9296-3cdffc3a3bf3" containerID="906f75775bb21b505fd91b68373f73fce06c95b23dac79a52b4cfe03cfc7132d" exitCode=0 Jun 14 20:23:06.553579 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.553126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" event={"ID":"8e688020-223a-40a2-9296-3cdffc3a3bf3","Type":"ContainerDied","Data":"906f75775bb21b505fd91b68373f73fce06c95b23dac79a52b4cfe03cfc7132d"} Jun 14 20:23:06.553579 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.553511 2576 scope.go:117] "RemoveContainer" containerID="906f75775bb21b505fd91b68373f73fce06c95b23dac79a52b4cfe03cfc7132d" Jun 14 20:23:06.850782 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.850743 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:06.915277 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:06.915237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:07.558392 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:07.558353 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-67xsl" event={"ID":"8e688020-223a-40a2-9296-3cdffc3a3bf3","Type":"ContainerStarted","Data":"cdbac0c28a6166e457e52b71887162c2a3f2aa6d9b403ac204eb005301f5f1f0"} Jun 14 20:23:09.079546 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:09.079510 2576 patch_prober.go:28] interesting pod/image-registry-6df6f86f6d-fbpch container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 20:23:09.079901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:09.079568 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:23:10.490374 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:10.490345 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:23:10.608256 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:10.608226 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:10.658944 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:10.658916 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:10.735678 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:10.735655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:10.837415 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:10.837393 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:13.405064 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:13.405035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:13.452376 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:13.452350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:15.472337 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:15.472297 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:15.572169 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:15.572124 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:15.673229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:15.673195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:18.160524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.160494 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:23:18.239217 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.239139 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:18.340951 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.340926 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:18.444042 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.443964 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:18.560925 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.560892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:18.662361 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:18.662334 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:19.617908 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:19.617878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:19.725069 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:19.725035 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:20.609094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:20.609061 2576 generic.go:356] "Generic (PLEG): container finished" podID="a23e54a1-88d8-49f2-b58c-6de52aad2100" containerID="b63896c7c051d11ee0881f5b9a96c2b4c3007c95132e63a87ca1785129c48bc5" exitCode=0 Jun 14 20:23:20.609215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:20.609142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" event={"ID":"a23e54a1-88d8-49f2-b58c-6de52aad2100","Type":"ContainerDied","Data":"b63896c7c051d11ee0881f5b9a96c2b4c3007c95132e63a87ca1785129c48bc5"} Jun 14 20:23:20.609488 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:20.609475 2576 scope.go:117] "RemoveContainer" containerID="b63896c7c051d11ee0881f5b9a96c2b4c3007c95132e63a87ca1785129c48bc5" Jun 14 20:23:21.250539 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:21.250512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9hc7f_aea2eb77-e8ec-40e4-b060-6f64b7114c40/serve-healthcheck-canary/0.log" Jun 14 20:23:21.615445 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:21.615409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-77rjc" event={"ID":"a23e54a1-88d8-49f2-b58c-6de52aad2100","Type":"ContainerStarted","Data":"78948189e49082649b30d9edb7f6018cde49305b491db044406c6abc6fba3318"} Jun 14 20:23:21.817956 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:21.817928 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-pcww7_fa5595a4-1a39-42f3-bcda-b61c3ce46b99/cluster-samples-operator/0.log" Jun 14 20:23:22.016788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:22.016719 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-pcww7_fa5595a4-1a39-42f3-bcda-b61c3ce46b99/cluster-samples-operator-watch/0.log" Jun 14 20:23:22.484223 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:22.484191 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:22.536135 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:22.536105 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:24.916983 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:24.916947 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:24.965378 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:24.965344 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:30.434482 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:30.434447 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:30.481283 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:30.481252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:33.601393 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:33.601358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:33.656546 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:33.656513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:39.278469 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:39.278433 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:39.375682 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:39.375652 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:39.427661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:39.427632 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:39.522801 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:39.522759 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:43.179965 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:43.179925 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerName="registry" containerID="cri-o://b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353" gracePeriod=30 Jun 14 20:23:44.427659 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.427637 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:23:44.511303 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511231 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511303 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmw5d\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511343 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511407 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511454 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511482 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511515 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") pod \"97fe87e8-1a3f-487f-b360-118443d3cc6b\" (UID: \"97fe87e8-1a3f-487f-b360-118443d3cc6b\") " Jun 14 20:23:44.511849 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.511793 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:23:44.512979 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.512941 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:23:44.513908 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.513861 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:44.514020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.513897 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:23:44.514020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.514003 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d" (OuterVolumeSpecName: "kube-api-access-jmw5d") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "kube-api-access-jmw5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:23:44.514110 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.514070 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:23:44.514225 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.514206 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:44.519814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.519792 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "97fe87e8-1a3f-487f-b360-118443d3cc6b" (UID: "97fe87e8-1a3f-487f-b360-118443d3cc6b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:23:44.612887 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612865 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-trusted-ca\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.612887 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612885 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-installation-pull-secrets\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612895 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-bound-sa-token\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612904 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-tls\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612912 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97fe87e8-1a3f-487f-b360-118443d3cc6b-image-registry-private-configuration\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612922 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmw5d\" (UniqueName: \"kubernetes.io/projected/97fe87e8-1a3f-487f-b360-118443d3cc6b-kube-api-access-jmw5d\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612930 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97fe87e8-1a3f-487f-b360-118443d3cc6b-ca-trust-extracted\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.613002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.612939 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97fe87e8-1a3f-487f-b360-118443d3cc6b-registry-certificates\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:44.704675 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.704646 2576 generic.go:356] "Generic (PLEG): container finished" podID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerID="b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353" exitCode=0 Jun 14 20:23:44.704788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.704693 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" Jun 14 20:23:44.704788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.704706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" event={"ID":"97fe87e8-1a3f-487f-b360-118443d3cc6b","Type":"ContainerDied","Data":"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353"} Jun 14 20:23:44.704788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.704747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6f86f6d-fbpch" event={"ID":"97fe87e8-1a3f-487f-b360-118443d3cc6b","Type":"ContainerDied","Data":"76fd639920129609027caebe07f896a2524931063d6110101a512769331d16b3"} Jun 14 20:23:44.704788 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.704769 2576 scope.go:117] "RemoveContainer" containerID="b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353" Jun 14 20:23:44.713202 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.713179 2576 scope.go:117] "RemoveContainer" containerID="b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353" Jun 14 20:23:44.713472 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:44.713450 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353\": container with ID starting with b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353 not found: ID does not exist" containerID="b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353" Jun 14 20:23:44.713539 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.713482 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353"} err="failed to get container status \"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353\": rpc error: code = NotFound desc = could not find container \"b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353\": container with ID starting with b6232f80e41040774910a2d191f86f60e934a7d8fc9efc1260393adcb9f7e353 not found: ID does not exist" Jun 14 20:23:44.724589 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.724565 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:23:44.728635 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:44.728616 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6df6f86f6d-fbpch"] Jun 14 20:23:45.498578 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:45.498545 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" path="/var/lib/kubelet/pods/97fe87e8-1a3f-487f-b360-118443d3cc6b/volumes" Jun 14 20:23:45.925627 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:45.925592 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:45.976216 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:45.976168 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:48.576834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:48.576803 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:48.629307 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:48.629277 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:54.150232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:54.150138 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:54.200094 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:54.200059 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:55.347711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:55.347673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:55.751229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:55.751125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:23:56.402475 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402433 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:56.402939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402829 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="alertmanager" containerID="cri-o://571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" gracePeriod=120 Jun 14 20:23:56.402939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402863 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-metric" containerID="cri-o://7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" gracePeriod=120 Jun 14 20:23:56.402939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402897 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="prom-label-proxy" containerID="cri-o://9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" gracePeriod=120 Jun 14 20:23:56.402939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402910 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="config-reloader" containerID="cri-o://e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" gracePeriod=120 Jun 14 20:23:56.403177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402931 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy" containerID="cri-o://6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" gracePeriod=120 Jun 14 20:23:56.403177 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.402872 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-web" containerID="cri-o://51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" gracePeriod=120 Jun 14 20:23:56.753528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753451 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" exitCode=0 Jun 14 20:23:56.753528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753474 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" exitCode=0 Jun 14 20:23:56.753528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753481 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" exitCode=0 Jun 14 20:23:56.753528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753487 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" exitCode=0 Jun 14 20:23:56.753528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189"} Jun 14 20:23:56.753767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619"} Jun 14 20:23:56.753767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359"} Jun 14 20:23:56.753767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:56.753632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26"} Jun 14 20:23:57.740249 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.740222 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:57.760975 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.760944 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" exitCode=0 Jun 14 20:23:57.760975 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.760967 2576 generic.go:356] "Generic (PLEG): container finished" podID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerID="51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" exitCode=0 Jun 14 20:23:57.761183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.760996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a"} Jun 14 20:23:57.761183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.761017 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:57.761183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.761067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3"} Jun 14 20:23:57.761183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.761109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0656a5e8-a23d-4ccb-95b2-018fc19b489f","Type":"ContainerDied","Data":"d2b639c27af273d868e7b29d93fe69cd9fef0e03754f76934df9176fc1f7d584"} Jun 14 20:23:57.761183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.761139 2576 scope.go:117] "RemoveContainer" containerID="9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" Jun 14 20:23:57.769044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.769020 2576 scope.go:117] "RemoveContainer" containerID="7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" Jun 14 20:23:57.776867 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.776841 2576 scope.go:117] "RemoveContainer" containerID="6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" Jun 14 20:23:57.783933 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.783920 2576 scope.go:117] "RemoveContainer" containerID="51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" Jun 14 20:23:57.790702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.790686 2576 scope.go:117] "RemoveContainer" containerID="e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" Jun 14 20:23:57.797529 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.797508 2576 scope.go:117] "RemoveContainer" containerID="571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" Jun 14 20:23:57.800634 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800618 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800652 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800683 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhmf2\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800705 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800755 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.800940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.800782 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801587 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801619 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801784 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801696 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801784 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801729 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.801895 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.801782 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle\") pod \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\" (UID: \"0656a5e8-a23d-4ccb-95b2-018fc19b489f\") " Jun 14 20:23:57.802566 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.802538 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:23:57.802661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.802538 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:23:57.802754 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.802731 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:23:57.803837 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.803803 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out" (OuterVolumeSpecName: "config-out") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:23:57.804246 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.804212 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:23:57.805133 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.805091 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.805249 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.805166 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2" (OuterVolumeSpecName: "kube-api-access-bhmf2") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "kube-api-access-bhmf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:23:57.807050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.806905 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume" (OuterVolumeSpecName: "config-volume") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.807050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.806923 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.807050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.806945 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.807050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.806956 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.807050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.806984 2576 scope.go:117] "RemoveContainer" containerID="e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3" Jun 14 20:23:57.810494 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.810462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.817631 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.817603 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config" (OuterVolumeSpecName: "web-config") pod "0656a5e8-a23d-4ccb-95b2-018fc19b489f" (UID: "0656a5e8-a23d-4ccb-95b2-018fc19b489f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:23:57.819550 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.819532 2576 scope.go:117] "RemoveContainer" containerID="9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" Jun 14 20:23:57.819834 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.819809 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189\": container with ID starting with 9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189 not found: ID does not exist" containerID="9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" Jun 14 20:23:57.819913 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.819842 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189"} err="failed to get container status \"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189\": rpc error: code = NotFound desc = could not find container \"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189\": container with ID starting with 9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189 not found: ID does not exist" Jun 14 20:23:57.819913 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.819864 2576 scope.go:117] "RemoveContainer" containerID="7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" Jun 14 20:23:57.820103 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.820084 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a\": container with ID starting with 7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a not found: ID does not exist" containerID="7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" Jun 14 20:23:57.820219 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820107 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a"} err="failed to get container status \"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a\": rpc error: code = NotFound desc = could not find container \"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a\": container with ID starting with 7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a not found: ID does not exist" Jun 14 20:23:57.820219 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820123 2576 scope.go:117] "RemoveContainer" containerID="6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" Jun 14 20:23:57.820380 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.820363 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619\": container with ID starting with 6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619 not found: ID does not exist" containerID="6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" Jun 14 20:23:57.820418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820385 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619"} err="failed to get container status \"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619\": rpc error: code = NotFound desc = could not find container \"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619\": container with ID starting with 6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619 not found: ID does not exist" Jun 14 20:23:57.820418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820399 2576 scope.go:117] "RemoveContainer" containerID="51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" Jun 14 20:23:57.820643 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.820622 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3\": container with ID starting with 51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3 not found: ID does not exist" containerID="51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" Jun 14 20:23:57.820683 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820650 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3"} err="failed to get container status \"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3\": rpc error: code = NotFound desc = could not find container \"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3\": container with ID starting with 51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3 not found: ID does not exist" Jun 14 20:23:57.820683 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820665 2576 scope.go:117] "RemoveContainer" containerID="e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" Jun 14 20:23:57.820888 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.820873 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359\": container with ID starting with e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359 not found: ID does not exist" containerID="e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" Jun 14 20:23:57.820926 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820893 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359"} err="failed to get container status \"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359\": rpc error: code = NotFound desc = could not find container \"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359\": container with ID starting with e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359 not found: ID does not exist" Jun 14 20:23:57.820926 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.820910 2576 scope.go:117] "RemoveContainer" containerID="571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" Jun 14 20:23:57.821132 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.821117 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26\": container with ID starting with 571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26 not found: ID does not exist" containerID="571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" Jun 14 20:23:57.821204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821135 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26"} err="failed to get container status \"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26\": rpc error: code = NotFound desc = could not find container \"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26\": container with ID starting with 571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26 not found: ID does not exist" Jun 14 20:23:57.821204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821170 2576 scope.go:117] "RemoveContainer" containerID="e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3" Jun 14 20:23:57.821421 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:23:57.821405 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3\": container with ID starting with e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3 not found: ID does not exist" containerID="e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3" Jun 14 20:23:57.821471 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821426 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3"} err="failed to get container status \"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3\": rpc error: code = NotFound desc = could not find container \"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3\": container with ID starting with e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3 not found: ID does not exist" Jun 14 20:23:57.821471 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821441 2576 scope.go:117] "RemoveContainer" containerID="9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189" Jun 14 20:23:57.821640 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821624 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189"} err="failed to get container status \"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189\": rpc error: code = NotFound desc = could not find container \"9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189\": container with ID starting with 9fa2013a54c43dacc1551f1a9ef038c7c2734865d5087b2204c7384106436189 not found: ID does not exist" Jun 14 20:23:57.821686 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821641 2576 scope.go:117] "RemoveContainer" containerID="7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a" Jun 14 20:23:57.821838 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821823 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a"} err="failed to get container status \"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a\": rpc error: code = NotFound desc = could not find container \"7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a\": container with ID starting with 7c646b670cd8d9dcd6b265eeaabc5166e040d4d7f59f2e540be49b77b3cdbb1a not found: ID does not exist" Jun 14 20:23:57.821898 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.821838 2576 scope.go:117] "RemoveContainer" containerID="6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619" Jun 14 20:23:57.822045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822029 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619"} err="failed to get container status \"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619\": rpc error: code = NotFound desc = could not find container \"6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619\": container with ID starting with 6204999a5abaf15ce236cde0ac144f5ac89a982e3dff062f2bd23b1a27eeb619 not found: ID does not exist" Jun 14 20:23:57.822045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822045 2576 scope.go:117] "RemoveContainer" containerID="51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3" Jun 14 20:23:57.822232 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822217 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3"} err="failed to get container status \"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3\": rpc error: code = NotFound desc = could not find container \"51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3\": container with ID starting with 51780918a69f86ae35756ca05e032d66bf65d9be98640f832db1009f446093d3 not found: ID does not exist" Jun 14 20:23:57.822284 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822232 2576 scope.go:117] "RemoveContainer" containerID="e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359" Jun 14 20:23:57.822411 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822397 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359"} err="failed to get container status \"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359\": rpc error: code = NotFound desc = could not find container \"e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359\": container with ID starting with e84b961bdbcb0d97bdf59be2e9c77646a47eeacb3aa05178d63ffe416560f359 not found: ID does not exist" Jun 14 20:23:57.822411 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822411 2576 scope.go:117] "RemoveContainer" containerID="571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26" Jun 14 20:23:57.822581 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822566 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26"} err="failed to get container status \"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26\": rpc error: code = NotFound desc = could not find container \"571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26\": container with ID starting with 571657d625045392065674ecfcfe71cb85d793fdd0939619cf1d91dedb5b4f26 not found: ID does not exist" Jun 14 20:23:57.822620 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822580 2576 scope.go:117] "RemoveContainer" containerID="e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3" Jun 14 20:23:57.822767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.822753 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3"} err="failed to get container status \"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3\": rpc error: code = NotFound desc = could not find container \"e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3\": container with ID starting with e8891ba63d51de098451bb8aeae3abd6c368cccd7b85d39b4375453a2c6ad7d3 not found: ID does not exist" Jun 14 20:23:57.902429 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902396 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-volume\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902429 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902429 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-main-db\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902440 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902450 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-web-config\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902460 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0656a5e8-a23d-4ccb-95b2-018fc19b489f-config-out\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902468 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhmf2\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-kube-api-access-bhmf2\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902475 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0656a5e8-a23d-4ccb-95b2-018fc19b489f-tls-assets\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902483 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-cluster-tls-config\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902491 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902501 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902509 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-main-tls\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902518 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0656a5e8-a23d-4ccb-95b2-018fc19b489f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:57.902548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:57.902526 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0656a5e8-a23d-4ccb-95b2-018fc19b489f-metrics-client-ca\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:23:58.084931 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.084905 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:58.089132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.089111 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:58.117775 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.117755 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:58.118023 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118010 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118025 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118037 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="config-reloader" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118043 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="config-reloader" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118051 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-web" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118057 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-web" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118066 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="prom-label-proxy" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118071 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="prom-label-proxy" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118080 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="init-config-reloader" Jun 14 20:23:58.118084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118085 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="init-config-reloader" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118093 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-metric" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118098 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-metric" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118104 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="alertmanager" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118109 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="alertmanager" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118117 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerName="registry" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118122 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerName="registry" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118186 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="prom-label-proxy" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118196 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fe87e8-1a3f-487f-b360-118443d3cc6b" containerName="registry" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118204 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-metric" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118209 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="config-reloader" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118214 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="alertmanager" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118220 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy" Jun 14 20:23:58.118368 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.118224 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" containerName="kube-rbac-proxy-web" Jun 14 20:23:58.123085 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.123068 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.125425 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 20:23:58.125557 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125534 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 20:23:58.125645 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-g2w22\"" Jun 14 20:23:58.125709 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125645 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 20:23:58.125709 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 20:23:58.125920 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.125905 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 20:23:58.126166 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.126127 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 20:23:58.126250 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.126133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 20:23:58.126250 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.126189 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 20:23:58.135542 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.133951 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 20:23:58.137683 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.137660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:58.205119 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205269 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205269 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-out\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205269 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205269 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9f46\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-kube-api-access-f9f46\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-web-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.205572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.205494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306375 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-web-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306375 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-out\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9f46\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-kube-api-access-f9f46\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.306957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.306810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.307486 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.307459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.308091 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.308065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309448 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-web-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309625 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309715 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309715 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309645 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309715 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.309960 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.309939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-volume\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.310048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.310034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.310528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.310512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.311189 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.311171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-config-out\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.315007 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.314990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9f46\" (UniqueName: \"kubernetes.io/projected/7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8-kube-api-access-f9f46\") pod \"alertmanager-main-0\" (UID: \"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.435815 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.435746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 20:23:58.570813 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.570768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 20:23:58.574315 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:23:58.574286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7098a1ac_dd1c_47c5_9e73_17c3fe8e36c8.slice/crio-2c16ac51bd3bda986fe98fce98b1c15495c3d4a52ea22505b59c4e39d921c462 WatchSource:0}: Error finding container 2c16ac51bd3bda986fe98fce98b1c15495c3d4a52ea22505b59c4e39d921c462: Status 404 returned error can't find the container with id 2c16ac51bd3bda986fe98fce98b1c15495c3d4a52ea22505b59c4e39d921c462 Jun 14 20:23:58.766626 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.766556 2576 generic.go:356] "Generic (PLEG): container finished" podID="7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8" containerID="04f092978153b8dc81caef439e595a948a040d200742ad0678ff743a8ae577ea" exitCode=0 Jun 14 20:23:58.766991 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.766637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerDied","Data":"04f092978153b8dc81caef439e595a948a040d200742ad0678ff743a8ae577ea"} Jun 14 20:23:58.766991 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:58.766698 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"2c16ac51bd3bda986fe98fce98b1c15495c3d4a52ea22505b59c4e39d921c462"} Jun 14 20:23:59.499005 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.498973 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0656a5e8-a23d-4ccb-95b2-018fc19b489f" path="/var/lib/kubelet/pods/0656a5e8-a23d-4ccb-95b2-018fc19b489f/volumes" Jun 14 20:23:59.775702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"5536d2a8444dce730565e274ed96f3aaaa007762a37779e2c66d9ef5b3a5b07b"} Jun 14 20:23:59.775702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"a50778fcf730e2a5a98199c73de646696d6ece62eb0384de7ef7087e080d1759"} Jun 14 20:23:59.776054 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"369cc2ac069da88312ad5cf6061cb26416047e562cdbe3e87214f1f244512236"} Jun 14 20:23:59.776054 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775744 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"eb8386263b09ac424bb8b1f7d747eb34260c51d23db251d5aaf179b822b5c69f"} Jun 14 20:23:59.776054 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"5a237504ed47a4b970309d0a0339854b2ef66e0ab1e93826d749000d1b17663e"} Jun 14 20:23:59.776054 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.775792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8","Type":"ContainerStarted","Data":"c02278815ad2086025b1c55dabeeabc7dc9ad4710ab00414f840212187e760ca"} Jun 14 20:23:59.809301 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:23:59.809255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.792938833 podStartE2EDuration="1.809237119s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.298286ms" isStatefulPod=false podCreationTimestamp="2026-06-14 20:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:23:59.806098615 +0000 UTC m=+356.675878082" watchObservedRunningTime="2026-06-14 20:23:59.809237119 +0000 UTC m=+356.679016551" Jun 14 20:24:00.423852 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.423813 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85486ff567-hgxnf"] Jun 14 20:24:00.427456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.427434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.429786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.429762 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cpnh9\"" Jun 14 20:24:00.430472 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.430444 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 14 20:24:00.430575 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.430483 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 14 20:24:00.430575 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.430523 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 14 20:24:00.430894 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.430754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 14 20:24:00.430894 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.430869 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 14 20:24:00.439609 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.439585 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 14 20:24:00.443340 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.443321 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85486ff567-hgxnf"] Jun 14 20:24:00.523183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-metrics-client-ca\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523302 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523302 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvgl\" (UniqueName: \"kubernetes.io/projected/4492d6bb-5e95-4b46-974a-881627ca35a3-kube-api-access-lqvgl\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523450 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-federate-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523450 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-serving-certs-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.523450 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.523447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.623865 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.623838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvgl\" (UniqueName: \"kubernetes.io/projected/4492d6bb-5e95-4b46-974a-881627ca35a3-kube-api-access-lqvgl\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.623981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.623873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.623981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.623904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.623981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.623946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-federate-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.623981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.623975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-serving-certs-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-metrics-client-ca\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624768 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-serving-certs-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-metrics-client-ca\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.624915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.624894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.626776 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.626754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-telemeter-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.626843 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.626754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-federate-client-tls\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.626985 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.626964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.627032 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.626993 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4492d6bb-5e95-4b46-974a-881627ca35a3-secret-telemeter-client\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.631702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.631679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvgl\" (UniqueName: \"kubernetes.io/projected/4492d6bb-5e95-4b46-974a-881627ca35a3-kube-api-access-lqvgl\") pod \"telemeter-client-85486ff567-hgxnf\" (UID: \"4492d6bb-5e95-4b46-974a-881627ca35a3\") " pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.739709 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.739650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" Jun 14 20:24:00.874613 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.874585 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85486ff567-hgxnf"] Jun 14 20:24:00.876455 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:24:00.876429 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4492d6bb_5e95_4b46_974a_881627ca35a3.slice/crio-a0654be20e7cabc3b46322a65e16100fb69ed8d73208d99803ff6b773de982c4 WatchSource:0}: Error finding container a0654be20e7cabc3b46322a65e16100fb69ed8d73208d99803ff6b773de982c4: Status 404 returned error can't find the container with id a0654be20e7cabc3b46322a65e16100fb69ed8d73208d99803ff6b773de982c4 Jun 14 20:24:00.878568 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:00.878549 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:24:01.786585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:01.786545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" event={"ID":"4492d6bb-5e95-4b46-974a-881627ca35a3","Type":"ContainerStarted","Data":"a0654be20e7cabc3b46322a65e16100fb69ed8d73208d99803ff6b773de982c4"} Jun 14 20:24:02.792413 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:02.792363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" event={"ID":"4492d6bb-5e95-4b46-974a-881627ca35a3","Type":"ContainerStarted","Data":"0a94629527227067e1233c24da40fa54967dc6a6edabd9d0bdc89c48fc16746c"} Jun 14 20:24:02.792783 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:02.792417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" event={"ID":"4492d6bb-5e95-4b46-974a-881627ca35a3","Type":"ContainerStarted","Data":"823d85531ba83afc2efb36d6da32f52848a2aa4ba146d88bbfad633777264fc8"} Jun 14 20:24:02.792783 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:02.792437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" event={"ID":"4492d6bb-5e95-4b46-974a-881627ca35a3","Type":"ContainerStarted","Data":"76dcbef62328d2ae7ea47286031e9b67f3d1250e669a151bcb0d72825f7411ba"} Jun 14 20:24:02.815212 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:02.815115 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85486ff567-hgxnf" podStartSLOduration=1.177345584 podStartE2EDuration="2.815097031s" totalImagesPullingTime="1.637751447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:24:02.813559956 +0000 UTC m=+359.683339429" watchObservedRunningTime="2026-06-14 20:24:02.815097031 +0000 UTC m=+359.684876461" Jun 14 20:24:03.673386 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:03.673359 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:03.726431 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:03.726378 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:03.780218 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:03.780192 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:04.376750 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:04.376720 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:04.423214 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:04.423187 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:14.706438 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:14.706405 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:14.804648 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:14.804620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:14.856081 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:14.856050 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:51.364746 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:51.364712 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:24:51.413253 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:24:51.413223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:10.612097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:10.612056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:10.666905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:10.666878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:22.483493 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:22.483424 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:22.534384 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:22.534355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:24.475224 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:24.475185 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:33.578301 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:33.578264 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:33.676618 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:33.676585 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:33.727528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:33.727501 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:33.926603 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:33.926534 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:35.011371 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:35.011341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:35.127431 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:35.127401 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:35.179081 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:35.179056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:25:59.435661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:25:59.435629 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:16.220766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.220730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:16.311176 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.311130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:16.817986 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.817956 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8"] Jun 14 20:26:16.821359 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.821344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:16.823922 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.823903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:26:16.824891 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.824873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:26:16.824989 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.824910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:26:16.829238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.829209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8"] Jun 14 20:26:16.933853 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.933817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:16.933987 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.933859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:16.933987 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:16.933890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqg9n\" (UniqueName: \"kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.035213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.035186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.035322 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.035225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.035322 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.035254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqg9n\" (UniqueName: \"kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.035652 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.035629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.035652 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.035644 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.043124 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.043097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqg9n\" (UniqueName: \"kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.131325 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.131276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:17.256010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.255982 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8"] Jun 14 20:26:17.258577 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:26:17.258551 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947d7ea7_64d8_47fd_8572_734bffb13ba3.slice/crio-81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9 WatchSource:0}: Error finding container 81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9: Status 404 returned error can't find the container with id 81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9 Jun 14 20:26:17.298339 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:17.298309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerStarted","Data":"81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9"} Jun 14 20:26:24.330182 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:24.330131 2576 generic.go:356] "Generic (PLEG): container finished" podID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerID="da11db216b545c15ab74d129927a3d9f37e38a1e1ffed94bbfe2c21da08f6736" exitCode=0 Jun 14 20:26:24.330577 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:24.330220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerDied","Data":"da11db216b545c15ab74d129927a3d9f37e38a1e1ffed94bbfe2c21da08f6736"} Jun 14 20:26:26.341915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:26.341883 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerStarted","Data":"4865f8b58a837afb2a75f5cc282827b99631249a771ea1a34680c66438cc8a9c"} Jun 14 20:26:27.347810 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:27.347781 2576 generic.go:356] "Generic (PLEG): container finished" podID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerID="4865f8b58a837afb2a75f5cc282827b99631249a771ea1a34680c66438cc8a9c" exitCode=0 Jun 14 20:26:27.348219 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:27.347843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerDied","Data":"4865f8b58a837afb2a75f5cc282827b99631249a771ea1a34680c66438cc8a9c"} Jun 14 20:26:35.385461 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:35.385428 2576 generic.go:356] "Generic (PLEG): container finished" podID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerID="167a74449b9c4edcf011be16968e5cb9457d3804fb6a77194bb5476386820989" exitCode=0 Jun 14 20:26:35.385832 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:35.385520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerDied","Data":"167a74449b9c4edcf011be16968e5cb9457d3804fb6a77194bb5476386820989"} Jun 14 20:26:36.517022 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.516998 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:36.601109 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.601083 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqg9n\" (UniqueName: \"kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n\") pod \"947d7ea7-64d8-47fd-8572-734bffb13ba3\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " Jun 14 20:26:36.601239 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.601222 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle\") pod \"947d7ea7-64d8-47fd-8572-734bffb13ba3\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " Jun 14 20:26:36.601293 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.601275 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util\") pod \"947d7ea7-64d8-47fd-8572-734bffb13ba3\" (UID: \"947d7ea7-64d8-47fd-8572-734bffb13ba3\") " Jun 14 20:26:36.602008 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.601981 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle" (OuterVolumeSpecName: "bundle") pod "947d7ea7-64d8-47fd-8572-734bffb13ba3" (UID: "947d7ea7-64d8-47fd-8572-734bffb13ba3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:26:36.603225 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.603205 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n" (OuterVolumeSpecName: "kube-api-access-hqg9n") pod "947d7ea7-64d8-47fd-8572-734bffb13ba3" (UID: "947d7ea7-64d8-47fd-8572-734bffb13ba3"). InnerVolumeSpecName "kube-api-access-hqg9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:26:36.605940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.605919 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util" (OuterVolumeSpecName: "util") pod "947d7ea7-64d8-47fd-8572-734bffb13ba3" (UID: "947d7ea7-64d8-47fd-8572-734bffb13ba3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:26:36.702320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.702272 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:36.702320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.702293 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqg9n\" (UniqueName: \"kubernetes.io/projected/947d7ea7-64d8-47fd-8572-734bffb13ba3-kube-api-access-hqg9n\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:36.702320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:36.702303 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947d7ea7-64d8-47fd-8572-734bffb13ba3-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:37.395078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:37.395038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" event={"ID":"947d7ea7-64d8-47fd-8572-734bffb13ba3","Type":"ContainerDied","Data":"81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9"} Jun 14 20:26:37.395285 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:37.395090 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81208cbfe86add9c447fbb1ef64659da33a7f0baa1cbbf97ee795df7d47028c9" Jun 14 20:26:37.395285 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:37.395053 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8m5z8" Jun 14 20:26:42.597520 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:42.597492 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:43.964110 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:43.964077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:44.540730 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.540694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq"] Jun 14 20:26:44.541062 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541044 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="util" Jun 14 20:26:44.541062 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541061 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="util" Jun 14 20:26:44.541213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541082 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="pull" Jun 14 20:26:44.541213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541088 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="pull" Jun 14 20:26:44.541213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541093 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="extract" Jun 14 20:26:44.541213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541098 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="extract" Jun 14 20:26:44.541213 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.541158 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="947d7ea7-64d8-47fd-8572-734bffb13ba3" containerName="extract" Jun 14 20:26:44.545517 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.545499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.547832 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.547813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tsrqp\"" Jun 14 20:26:44.548045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.548033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 20:26:44.548138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.548118 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:26:44.557409 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.557390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq"] Jun 14 20:26:44.665015 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.664985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.665124 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.665040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlk4q\" (UniqueName: \"kubernetes.io/projected/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-kube-api-access-mlk4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.765666 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.765638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.765779 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.765683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlk4q\" (UniqueName: \"kubernetes.io/projected/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-kube-api-access-mlk4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.765983 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.765964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.776764 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.776746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlk4q\" (UniqueName: \"kubernetes.io/projected/1866d44b-c4f4-4eb1-84e2-ac7281af2c11-kube-api-access-mlk4q\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6vxdq\" (UID: \"1866d44b-c4f4-4eb1-84e2-ac7281af2c11\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:44.854733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:44.854712 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" Jun 14 20:26:45.005287 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:45.005063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq"] Jun 14 20:26:45.008632 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:26:45.008587 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1866d44b_c4f4_4eb1_84e2_ac7281af2c11.slice/crio-29918b725bf17a8cea7f2285c6dd54c45ab31a9e3a1812d1c47c5357cbbeda2a WatchSource:0}: Error finding container 29918b725bf17a8cea7f2285c6dd54c45ab31a9e3a1812d1c47c5357cbbeda2a: Status 404 returned error can't find the container with id 29918b725bf17a8cea7f2285c6dd54c45ab31a9e3a1812d1c47c5357cbbeda2a Jun 14 20:26:45.427909 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:45.427879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" event={"ID":"1866d44b-c4f4-4eb1-84e2-ac7281af2c11","Type":"ContainerStarted","Data":"29918b725bf17a8cea7f2285c6dd54c45ab31a9e3a1812d1c47c5357cbbeda2a"} Jun 14 20:26:46.204231 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:46.204197 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:46.310729 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:46.310697 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:47.253728 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.253690 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:47.353320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.353289 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:47.440387 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.440357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" event={"ID":"1866d44b-c4f4-4eb1-84e2-ac7281af2c11","Type":"ContainerStarted","Data":"78fd7a801f4eec66957449379b085c704c37dc9c05cbeba26ca7a1d8f4468e16"} Jun 14 20:26:47.462048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.462002 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6vxdq" podStartSLOduration=1.9838306399999999 podStartE2EDuration="3.461987644s" totalImagesPullingTime="1.478157004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:26:47.459715868 +0000 UTC m=+524.329495324" watchObservedRunningTime="2026-06-14 20:26:47.461987644 +0000 UTC m=+524.331767075" Jun 14 20:26:47.828927 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.828894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:47.933724 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:47.933696 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:49.081733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.081700 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd"] Jun 14 20:26:49.083886 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.083869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.086290 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.086266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 20:26:49.086439 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.086418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 20:26:49.087307 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.087291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7q4dl\"" Jun 14 20:26:49.094489 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.094470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd"] Jun 14 20:26:49.100494 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.100474 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gd97\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-kube-api-access-8gd97\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.100563 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.100524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.201458 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.201434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.201546 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.201484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gd97\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-kube-api-access-8gd97\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.211892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.211870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gd97\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-kube-api-access-8gd97\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.211996 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.211980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63347b3c-db36-41be-8761-d335ea97e50b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mmqcd\" (UID: \"63347b3c-db36-41be-8761-d335ea97e50b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.217461 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.217424 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr"] Jun 14 20:26:49.220059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.220044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.222541 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.222520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:26:49.222643 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.222544 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:26:49.222643 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.222625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:26:49.229909 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.229884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr"] Jun 14 20:26:49.301929 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.301894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.302086 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.301942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.302086 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.302044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztmnn\" (UniqueName: \"kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.401200 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.401124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:49.402372 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.402352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.402454 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.402409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztmnn\" (UniqueName: \"kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.402454 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.402434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.402760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.402739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.402845 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.402760 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.411208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.411181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztmnn\" (UniqueName: \"kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.523946 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.523924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd"] Jun 14 20:26:49.526052 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:26:49.526026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63347b3c_db36_41be_8761_d335ea97e50b.slice/crio-d1fd89bb01c96f85a09fb9924372a07bcc201f7e3b64450b6d6b01812ce78768 WatchSource:0}: Error finding container d1fd89bb01c96f85a09fb9924372a07bcc201f7e3b64450b6d6b01812ce78768: Status 404 returned error can't find the container with id d1fd89bb01c96f85a09fb9924372a07bcc201f7e3b64450b6d6b01812ce78768 Jun 14 20:26:49.533454 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.533433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:49.655055 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:49.655031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr"] Jun 14 20:26:49.656562 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:26:49.656534 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b24cae0_0f71_4c42_b891_a1d5cc20cfcc.slice/crio-250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9 WatchSource:0}: Error finding container 250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9: Status 404 returned error can't find the container with id 250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9 Jun 14 20:26:50.456821 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:50.456786 2576 generic.go:356] "Generic (PLEG): container finished" podID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerID="29f5207add7f7565fc254c127fa61730307e463ef822b7ad64fb461bdbc1fb3b" exitCode=0 Jun 14 20:26:50.457290 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:50.456871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" event={"ID":"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc","Type":"ContainerDied","Data":"29f5207add7f7565fc254c127fa61730307e463ef822b7ad64fb461bdbc1fb3b"} Jun 14 20:26:50.457290 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:50.456929 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" event={"ID":"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc","Type":"ContainerStarted","Data":"250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9"} Jun 14 20:26:50.458911 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:50.458888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" event={"ID":"63347b3c-db36-41be-8761-d335ea97e50b","Type":"ContainerStarted","Data":"d1fd89bb01c96f85a09fb9924372a07bcc201f7e3b64450b6d6b01812ce78768"} Jun 14 20:26:50.561340 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:50.561307 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:51.156952 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:51.156908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:52.997962 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:52.997931 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:53.052036 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.052007 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:53.475786 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.475753 2576 generic.go:356] "Generic (PLEG): container finished" podID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerID="6ddc7b0e86a52e98846160ae16174bdadd65f9b0e73779644d4c162edfce36f5" exitCode=0 Jun 14 20:26:53.475965 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.475830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" event={"ID":"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc","Type":"ContainerDied","Data":"6ddc7b0e86a52e98846160ae16174bdadd65f9b0e73779644d4c162edfce36f5"} Jun 14 20:26:53.477430 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.477400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" event={"ID":"63347b3c-db36-41be-8761-d335ea97e50b","Type":"ContainerStarted","Data":"b7a8909513ce043b4090d9f3d051c89c10802b1c6983e88f0ff9b14affcf7b28"} Jun 14 20:26:53.477534 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.477478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:26:53.510881 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:53.510838 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" podStartSLOduration=1.165338572 podStartE2EDuration="4.510824156s" totalImagesPullingTime="3.345485584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:26:53.5099976 +0000 UTC m=+530.379777032" watchObservedRunningTime="2026-06-14 20:26:53.510824156 +0000 UTC m=+530.380603587" Jun 14 20:26:54.483563 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:54.483525 2576 generic.go:356] "Generic (PLEG): container finished" podID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerID="d51327721efebc13f40fa8032af83f47c8ea04ddb1f1f9ae472fc30e8e533ad9" exitCode=0 Jun 14 20:26:54.483926 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:54.483596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" event={"ID":"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc","Type":"ContainerDied","Data":"d51327721efebc13f40fa8032af83f47c8ea04ddb1f1f9ae472fc30e8e533ad9"} Jun 14 20:26:55.344248 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.344212 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2"] Jun 14 20:26:55.347969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.347948 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.350677 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.350659 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s57vz\"" Jun 14 20:26:55.355926 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.355905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2"] Jun 14 20:26:55.455468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.455439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cls25\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-kube-api-access-cls25\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.455583 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.455494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.556798 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.556771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cls25\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-kube-api-access-cls25\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.557126 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.556839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.565119 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.565093 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cls25\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-kube-api-access-cls25\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.565602 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.565585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e2a0de-382e-4c4f-a74e-1fc1034151c6-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-t5pt2\" (UID: \"40e2a0de-382e-4c4f-a74e-1fc1034151c6\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.613585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.613562 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:55.657724 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.657702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" Jun 14 20:26:55.657834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.657815 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util\") pod \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " Jun 14 20:26:55.657889 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.657851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle\") pod \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " Jun 14 20:26:55.657889 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.657870 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztmnn\" (UniqueName: \"kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn\") pod \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\" (UID: \"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc\") " Jun 14 20:26:55.658229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.658208 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle" (OuterVolumeSpecName: "bundle") pod "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" (UID: "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:26:55.659823 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.659802 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn" (OuterVolumeSpecName: "kube-api-access-ztmnn") pod "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" (UID: "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc"). InnerVolumeSpecName "kube-api-access-ztmnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:26:55.664544 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.664520 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util" (OuterVolumeSpecName: "util") pod "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" (UID: "3b24cae0-0f71-4c42-b891-a1d5cc20cfcc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:26:55.758960 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.758928 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:55.759097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.758964 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztmnn\" (UniqueName: \"kubernetes.io/projected/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-kube-api-access-ztmnn\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:55.759097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.758980 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b24cae0-0f71-4c42-b891-a1d5cc20cfcc-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:26:55.783022 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:55.782997 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2"] Jun 14 20:26:56.475293 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.475258 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:56.494856 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.494825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" event={"ID":"40e2a0de-382e-4c4f-a74e-1fc1034151c6","Type":"ContainerStarted","Data":"97b23a84e3d7bd748d7518e641aaaf4e632b5e3df0ea73d16fd061e4fee1645e"} Jun 14 20:26:56.494981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.494861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" event={"ID":"40e2a0de-382e-4c4f-a74e-1fc1034151c6","Type":"ContainerStarted","Data":"0566e5b44e3e6a70ef0a316e66df645d9857e04e59430609554d3d2a33eeba15"} Jun 14 20:26:56.496571 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.496552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" event={"ID":"3b24cae0-0f71-4c42-b891-a1d5cc20cfcc","Type":"ContainerDied","Data":"250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9"} Jun 14 20:26:56.496571 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.496559 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr5vcr" Jun 14 20:26:56.496800 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.496582 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="250fb6a18b9b650ed914b76b035723b5dc3b81ecb796629a4bca463efc0303e9" Jun 14 20:26:56.517669 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.517629 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-t5pt2" podStartSLOduration=1.517615443 podStartE2EDuration="1.517615443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:26:56.516273467 +0000 UTC m=+533.386052898" watchObservedRunningTime="2026-06-14 20:26:56.517615443 +0000 UTC m=+533.387394874" Jun 14 20:26:56.575696 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:56.575673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:59.172574 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:59.172537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:26:59.485953 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:26:59.485874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mmqcd" Jun 14 20:27:04.410720 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:04.410687 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:04.511313 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:04.511266 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:10.888524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:10.888489 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:10.988366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:10.988331 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:12.975938 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:12.975908 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:14.265083 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265048 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746"] Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265389 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="extract" Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265402 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="extract" Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265417 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="util" Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265423 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="util" Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265430 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="pull" Jun 14 20:27:14.265465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265435 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="pull" Jun 14 20:27:14.265649 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.265494 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b24cae0-0f71-4c42-b891-a1d5cc20cfcc" containerName="extract" Jun 14 20:27:14.267687 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.267665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.270106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.270076 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:27:14.270225 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.270138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:27:14.270298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.270221 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:27:14.277138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.277114 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746"] Jun 14 20:27:14.406384 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.406359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.406543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.406394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.406543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.406463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw5qx\" (UniqueName: \"kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.507245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.507213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.507389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.507257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.507389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.507332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw5qx\" (UniqueName: \"kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.507572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.507549 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.507644 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.507607 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.515171 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.515106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw5qx\" (UniqueName: \"kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.579723 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.579701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:14.705261 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:14.705232 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746"] Jun 14 20:27:14.706954 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:27:14.706930 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2d6cb6_c9a3_4e3e_88db_1e0bb02603f5.slice/crio-1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0 WatchSource:0}: Error finding container 1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0: Status 404 returned error can't find the container with id 1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0 Jun 14 20:27:15.577138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:15.577110 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerID="49da37cfe07791f17bef5e508fbf699c14b0b363ba497580d39470ec1c6d867b" exitCode=0 Jun 14 20:27:15.577508 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:15.577191 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" event={"ID":"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5","Type":"ContainerDied","Data":"49da37cfe07791f17bef5e508fbf699c14b0b363ba497580d39470ec1c6d867b"} Jun 14 20:27:15.577508 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:15.577235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" event={"ID":"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5","Type":"ContainerStarted","Data":"1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0"} Jun 14 20:27:16.584253 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:16.584220 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerID="f7aabc4fc8fed3b3ce8b9c3974d21903b5d885325bb48e02253e5af93437ddcc" exitCode=0 Jun 14 20:27:16.584673 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:16.584305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" event={"ID":"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5","Type":"ContainerDied","Data":"f7aabc4fc8fed3b3ce8b9c3974d21903b5d885325bb48e02253e5af93437ddcc"} Jun 14 20:27:17.185641 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.185601 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:17.218477 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.218441 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j"] Jun 14 20:27:17.221533 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.221513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.225158 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225126 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 20:27:17.225317 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 20:27:17.225317 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225272 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 20:27:17.225450 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225254 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vkllh\"" Jun 14 20:27:17.225450 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225339 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 20:27:17.225569 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.225555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 20:27:17.232323 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.232307 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j"] Jun 14 20:27:17.252909 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.252882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:17.329031 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.329000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c02000ed-e6a9-4b16-a725-387faabe4b7e-manager-config\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.329204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.329038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-metrics-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.329204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.329118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.329204 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.329154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2mz6\" (UniqueName: \"kubernetes.io/projected/c02000ed-e6a9-4b16-a725-387faabe4b7e-kube-api-access-s2mz6\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.430238 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.430207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.430382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.430242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2mz6\" (UniqueName: \"kubernetes.io/projected/c02000ed-e6a9-4b16-a725-387faabe4b7e-kube-api-access-s2mz6\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.430423 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.430372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c02000ed-e6a9-4b16-a725-387faabe4b7e-manager-config\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.430466 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.430420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-metrics-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.431060 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.431041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c02000ed-e6a9-4b16-a725-387faabe4b7e-manager-config\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.432623 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.432601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.432702 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.432655 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c02000ed-e6a9-4b16-a725-387faabe4b7e-metrics-cert\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.438548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.438499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2mz6\" (UniqueName: \"kubernetes.io/projected/c02000ed-e6a9-4b16-a725-387faabe4b7e-kube-api-access-s2mz6\") pod \"lws-controller-manager-5cc48dd6f6-bww2j\" (UID: \"c02000ed-e6a9-4b16-a725-387faabe4b7e\") " pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.530625 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.530599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:17.594157 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.594116 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerID="5080e1052078bb0a2bd2ce7832b8309345e6d34e029fce7db5bb660db841d6de" exitCode=0 Jun 14 20:27:17.594447 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.594178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" event={"ID":"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5","Type":"ContainerDied","Data":"5080e1052078bb0a2bd2ce7832b8309345e6d34e029fce7db5bb660db841d6de"} Jun 14 20:27:17.663366 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:17.663337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j"] Jun 14 20:27:17.666582 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:27:17.666555 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc02000ed_e6a9_4b16_a725_387faabe4b7e.slice/crio-f74de35e530b48ba5de5bf77583e2002dee535dde1ce2bc02f1ac8b53ad952a1 WatchSource:0}: Error finding container f74de35e530b48ba5de5bf77583e2002dee535dde1ce2bc02f1ac8b53ad952a1: Status 404 returned error can't find the container with id f74de35e530b48ba5de5bf77583e2002dee535dde1ce2bc02f1ac8b53ad952a1 Jun 14 20:27:18.601937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.601902 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" event={"ID":"c02000ed-e6a9-4b16-a725-387faabe4b7e","Type":"ContainerStarted","Data":"f74de35e530b48ba5de5bf77583e2002dee535dde1ce2bc02f1ac8b53ad952a1"} Jun 14 20:27:18.747290 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.747267 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:18.840854 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.840824 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util\") pod \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " Jun 14 20:27:18.841005 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.840876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle\") pod \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " Jun 14 20:27:18.841005 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.840944 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw5qx\" (UniqueName: \"kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx\") pod \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\" (UID: \"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5\") " Jun 14 20:27:18.841784 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.841753 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle" (OuterVolumeSpecName: "bundle") pod "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" (UID: "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:27:18.843455 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.843413 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx" (OuterVolumeSpecName: "kube-api-access-dw5qx") pod "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" (UID: "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5"). InnerVolumeSpecName "kube-api-access-dw5qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:27:18.847652 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.847606 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util" (OuterVolumeSpecName: "util") pod "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" (UID: "1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:27:18.942165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.942067 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw5qx\" (UniqueName: \"kubernetes.io/projected/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-kube-api-access-dw5qx\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:18.942165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.942104 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:18.942165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:18.942117 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:19.608365 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.608336 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" Jun 14 20:27:19.608749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.608334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdld746" event={"ID":"1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5","Type":"ContainerDied","Data":"1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0"} Jun 14 20:27:19.608749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.608465 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f821a91ee530a1b5017f04a19b2778dd87dc830868a49c2b87596d3a59719a0" Jun 14 20:27:19.609953 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.609930 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" event={"ID":"c02000ed-e6a9-4b16-a725-387faabe4b7e","Type":"ContainerStarted","Data":"99efb5f0d6aff6daf7a94a2392090ec47563fc711d70261c5c21d0ea116be40e"} Jun 14 20:27:19.610088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.609985 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:19.626245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:19.626209 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" podStartSLOduration=1.104682285 podStartE2EDuration="2.626195605s" totalImagesPullingTime="1.52151332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:19.625098021 +0000 UTC m=+556.494877472" watchObservedRunningTime="2026-06-14 20:27:19.626195605 +0000 UTC m=+556.495975040" Jun 14 20:27:25.408473 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:25.408427 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:25.511394 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:25.511362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.051952 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.051917 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.268715 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.268684 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.368869 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.368800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.418767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.418737 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2"] Jun 14 20:27:26.419088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419052 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="pull" Jun 14 20:27:26.419088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419063 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="pull" Jun 14 20:27:26.419088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419082 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="util" Jun 14 20:27:26.419088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419090 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="util" Jun 14 20:27:26.419235 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419098 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="extract" Jun 14 20:27:26.419235 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419105 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="extract" Jun 14 20:27:26.419235 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.419173 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2d6cb6-c9a3-4e3e-88db-1e0bb02603f5" containerName="extract" Jun 14 20:27:26.422226 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.422206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.425046 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.425020 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hcw4f\"" Jun 14 20:27:26.425046 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.425035 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 20:27:26.425267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.425058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 20:27:26.425267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.425068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 20:27:26.425267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.425080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 20:27:26.435195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.435170 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2"] Jun 14 20:27:26.504155 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.504127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.504278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.504206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdlkb\" (UniqueName: \"kubernetes.io/projected/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-kube-api-access-tdlkb\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.504278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.504237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.504278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.504253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.504278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.504271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.528502 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.528476 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.604565 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.604539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.604658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.604575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.604658 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.604637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdlkb\" (UniqueName: \"kubernetes.io/projected/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-kube-api-access-tdlkb\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.604818 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.604798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.604881 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.604833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.605208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.605186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-manifests\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.606990 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.606967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-tmp\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.607194 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.607174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.607267 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.607176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.613889 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.613864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdlkb\" (UniqueName: \"kubernetes.io/projected/d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc-kube-api-access-tdlkb\") pod \"opendatahub-operator-controller-manager-86cf7969f6-t99j2\" (UID: \"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc\") " pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.625996 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.625939 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.726279 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.726228 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.732509 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.732488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:26.851451 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.851422 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:26.879416 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.879383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2"] Jun 14 20:27:26.881644 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:27:26.881618 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23ad5e2_1fb8_46c3_b1e6_3adf25cd3bbc.slice/crio-9f0f100facf5673f3cc387d5b16dacb41bf46bda5d8ec25fb1c9d6c27457caa7 WatchSource:0}: Error finding container 9f0f100facf5673f3cc387d5b16dacb41bf46bda5d8ec25fb1c9d6c27457caa7: Status 404 returned error can't find the container with id 9f0f100facf5673f3cc387d5b16dacb41bf46bda5d8ec25fb1c9d6c27457caa7 Jun 14 20:27:26.929436 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:26.929410 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:27.029901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:27.029852 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:27.129386 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:27.129309 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:27.230422 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:27.230384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:27.651840 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:27.651804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" event={"ID":"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc","Type":"ContainerStarted","Data":"9f0f100facf5673f3cc387d5b16dacb41bf46bda5d8ec25fb1c9d6c27457caa7"} Jun 14 20:27:30.616058 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:30.616032 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cc48dd6f6-bww2j" Jun 14 20:27:30.668184 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:30.668138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" event={"ID":"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc","Type":"ContainerStarted","Data":"df115b3b28c921a28be7ce6c83c36a970d3c5eaf1ff1ed262e03fbb466affde3"} Jun 14 20:27:31.674528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:31.674494 2576 generic.go:356] "Generic (PLEG): container finished" podID="d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc" containerID="df115b3b28c921a28be7ce6c83c36a970d3c5eaf1ff1ed262e03fbb466affde3" exitCode=0 Jun 14 20:27:31.674902 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:31.674560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" event={"ID":"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc","Type":"ContainerDied","Data":"df115b3b28c921a28be7ce6c83c36a970d3c5eaf1ff1ed262e03fbb466affde3"} Jun 14 20:27:32.687073 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:32.687034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" event={"ID":"d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc","Type":"ContainerStarted","Data":"cce68a9f2479cb6da55950b1b0f2dfcca27d243341f20103fef39a70b40f7323"} Jun 14 20:27:32.687492 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:32.687215 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:37.009828 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:37.009793 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:37.126184 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:37.126135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:39.483360 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:39.483324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:39.583299 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:39.583275 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:39.900617 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:39.900580 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:40.006137 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:40.006104 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:43.693326 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:43.693296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" Jun 14 20:27:43.715165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:43.715090 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86cf7969f6-t99j2" podStartSLOduration=13.638990034999999 podStartE2EDuration="17.715071782s" totalImagesPullingTime="3.062589072s" totalInitContainerRuntime="1.013492675s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:32.728070882 +0000 UTC m=+569.597850314" watchObservedRunningTime="2026-06-14 20:27:43.715071782 +0000 UTC m=+580.584851213" Jun 14 20:27:45.322214 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:45.322131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:45.432318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:45.432285 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:45.582730 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:45.582641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:45.695416 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:45.695384 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:45.839960 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:45.839880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.017468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.017427 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-28mkb"] Jun 14 20:27:46.025604 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.025575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.028383 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.028362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qh7rg\"" Jun 14 20:27:46.029452 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.029431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 20:27:46.029855 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.029829 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 20:27:46.029988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.029962 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 20:27:46.030063 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.029985 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 20:27:46.032620 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.032595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-28mkb"] Jun 14 20:27:46.092304 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.092215 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.150215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.150190 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.165329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.165303 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8gb\" (UniqueName: \"kubernetes.io/projected/0d7e95b0-e191-421e-9a35-f30d435cef15-kube-api-access-8b8gb\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.165421 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.165349 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d7e95b0-e191-421e-9a35-f30d435cef15-tmp\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.165463 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.165441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.250687 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.250659 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.266828 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.266806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d7e95b0-e191-421e-9a35-f30d435cef15-tmp\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.266899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.266869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.266948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.266910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8gb\" (UniqueName: \"kubernetes.io/projected/0d7e95b0-e191-421e-9a35-f30d435cef15-kube-api-access-8b8gb\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.267018 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:27:46.267002 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 14 20:27:46.267078 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:27:46.267068 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs podName:0d7e95b0-e191-421e-9a35-f30d435cef15 nodeName:}" failed. No retries permitted until 2026-06-14 20:27:46.76705253 +0000 UTC m=+583.636831939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs") pod "kube-auth-proxy-686f9db88b-28mkb" (UID: "0d7e95b0-e191-421e-9a35-f30d435cef15") : secret "kube-auth-proxy-tls" not found Jun 14 20:27:46.269302 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.269280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d7e95b0-e191-421e-9a35-f30d435cef15-tmp\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.277507 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.277487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8gb\" (UniqueName: \"kubernetes.io/projected/0d7e95b0-e191-421e-9a35-f30d435cef15-kube-api-access-8b8gb\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.351691 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.351633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.452329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.452303 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.653948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.653875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.772104 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.772078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.774600 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.774574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d7e95b0-e191-421e-9a35-f30d435cef15-tls-certs\") pod \"kube-auth-proxy-686f9db88b-28mkb\" (UID: \"0d7e95b0-e191-421e-9a35-f30d435cef15\") " pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:46.853329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.853296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:46.936106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:46.936021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" Jun 14 20:27:47.062322 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.062296 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686f9db88b-28mkb"] Jun 14 20:27:47.063942 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:27:47.063905 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7e95b0_e191_421e_9a35_f30d435cef15.slice/crio-ef34786507e1c76a411b292d2ba1c35ffa87da5d60b082c3c3163051e561e253 WatchSource:0}: Error finding container ef34786507e1c76a411b292d2ba1c35ffa87da5d60b082c3c3163051e561e253: Status 404 returned error can't find the container with id ef34786507e1c76a411b292d2ba1c35ffa87da5d60b082c3c3163051e561e253 Jun 14 20:27:47.608360 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.608324 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477"] Jun 14 20:27:47.613489 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.613465 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.615778 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.615754 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:27:47.615868 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.615783 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:27:47.616854 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.616834 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:27:47.619822 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.619797 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477"] Jun 14 20:27:47.679516 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.679485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvgsg\" (UniqueName: \"kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.679662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.679533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.679662 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.679584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.764229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.764196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" event={"ID":"0d7e95b0-e191-421e-9a35-f30d435cef15","Type":"ContainerStarted","Data":"ef34786507e1c76a411b292d2ba1c35ffa87da5d60b082c3c3163051e561e253"} Jun 14 20:27:47.780754 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.780721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvgsg\" (UniqueName: \"kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.780949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.780770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.780949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.780855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.781203 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.781179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.781329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.781224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.788625 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.788601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvgsg\" (UniqueName: \"kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:47.925766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:47.925524 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:48.117901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:48.117757 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477"] Jun 14 20:27:48.119709 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:27:48.119666 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12059851_7715_458a_bdf5_d288b0ac3c6b.slice/crio-288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca WatchSource:0}: Error finding container 288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca: Status 404 returned error can't find the container with id 288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca Jun 14 20:27:48.773420 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:48.773291 2576 generic.go:356] "Generic (PLEG): container finished" podID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerID="2d96565eb492071d2045ab672bae178e7af5136a659e0a85cc5618ee053137ab" exitCode=0 Jun 14 20:27:48.773420 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:48.773400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" event={"ID":"12059851-7715-458a-bdf5-d288b0ac3c6b","Type":"ContainerDied","Data":"2d96565eb492071d2045ab672bae178e7af5136a659e0a85cc5618ee053137ab"} Jun 14 20:27:48.773959 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:48.773486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" event={"ID":"12059851-7715-458a-bdf5-d288b0ac3c6b","Type":"ContainerStarted","Data":"288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca"} Jun 14 20:27:50.785422 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:50.785387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" event={"ID":"0d7e95b0-e191-421e-9a35-f30d435cef15","Type":"ContainerStarted","Data":"009a8ce0aba0969ad8a6a2b07df3496c8dd756e6a4a459ab5d460f28dbbf9ff0"} Jun 14 20:27:50.787123 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:50.787099 2576 generic.go:356] "Generic (PLEG): container finished" podID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerID="49b8b5261a7cb16eb8329290839be48dc237ad347c56c727c3f3c96e087418ad" exitCode=0 Jun 14 20:27:50.787256 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:50.787184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" event={"ID":"12059851-7715-458a-bdf5-d288b0ac3c6b","Type":"ContainerDied","Data":"49b8b5261a7cb16eb8329290839be48dc237ad347c56c727c3f3c96e087418ad"} Jun 14 20:27:50.800499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:50.800443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-686f9db88b-28mkb" podStartSLOduration=2.903407381 podStartE2EDuration="5.800416384s" totalImagesPullingTime="2.897009003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:27:50.799451171 +0000 UTC m=+587.669230623" watchObservedRunningTime="2026-06-14 20:27:50.800416384 +0000 UTC m=+587.670195815" Jun 14 20:27:51.794022 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:51.793989 2576 generic.go:356] "Generic (PLEG): container finished" podID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerID="420903963dc1aea947b03ff247835d1ece529386c583968cb0fa492750eb1942" exitCode=0 Jun 14 20:27:51.794499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:51.794089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" event={"ID":"12059851-7715-458a-bdf5-d288b0ac3c6b","Type":"ContainerDied","Data":"420903963dc1aea947b03ff247835d1ece529386c583968cb0fa492750eb1942"} Jun 14 20:27:52.923904 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:52.923879 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:53.030229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.030202 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util\") pod \"12059851-7715-458a-bdf5-d288b0ac3c6b\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " Jun 14 20:27:53.030382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.030284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle\") pod \"12059851-7715-458a-bdf5-d288b0ac3c6b\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " Jun 14 20:27:53.030382 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.030319 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvgsg\" (UniqueName: \"kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg\") pod \"12059851-7715-458a-bdf5-d288b0ac3c6b\" (UID: \"12059851-7715-458a-bdf5-d288b0ac3c6b\") " Jun 14 20:27:53.031106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.031082 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle" (OuterVolumeSpecName: "bundle") pod "12059851-7715-458a-bdf5-d288b0ac3c6b" (UID: "12059851-7715-458a-bdf5-d288b0ac3c6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:27:53.032405 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.032378 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg" (OuterVolumeSpecName: "kube-api-access-bvgsg") pod "12059851-7715-458a-bdf5-d288b0ac3c6b" (UID: "12059851-7715-458a-bdf5-d288b0ac3c6b"). InnerVolumeSpecName "kube-api-access-bvgsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:27:53.036270 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.036248 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util" (OuterVolumeSpecName: "util") pod "12059851-7715-458a-bdf5-d288b0ac3c6b" (UID: "12059851-7715-458a-bdf5-d288b0ac3c6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:27:53.131524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.131466 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:53.131524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.131489 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12059851-7715-458a-bdf5-d288b0ac3c6b-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:53.131524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.131499 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvgsg\" (UniqueName: \"kubernetes.io/projected/12059851-7715-458a-bdf5-d288b0ac3c6b-kube-api-access-bvgsg\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:27:53.805058 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.805033 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" Jun 14 20:27:53.805226 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.805059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab065q477" event={"ID":"12059851-7715-458a-bdf5-d288b0ac3c6b","Type":"ContainerDied","Data":"288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca"} Jun 14 20:27:53.805226 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:53.805098 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="288ec7fcc35ea15435a7c5a4ab02eab8b3a408daa706d7af27213793d1081cca" Jun 14 20:27:55.107331 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:55.107295 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:55.213554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:55.213523 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:55.305070 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:55.305041 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:56.409083 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:56.409053 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:27:56.502544 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:27:56.502506 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:00.769672 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:00.769633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:00.874336 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:00.874300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:01.775078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:01.775046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:01.934561 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:01.934526 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:02.198524 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.198493 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:02.300477 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.300447 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:02.761102 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt"] Jun 14 20:28:02.761445 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761429 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="extract" Jun 14 20:28:02.761445 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761446 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="extract" Jun 14 20:28:02.761567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761457 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="pull" Jun 14 20:28:02.761567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761463 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="pull" Jun 14 20:28:02.761567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761477 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="util" Jun 14 20:28:02.761567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761482 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="util" Jun 14 20:28:02.761567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.761551 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="12059851-7715-458a-bdf5-d288b0ac3c6b" containerName="extract" Jun 14 20:28:02.768402 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.768381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.771513 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.771487 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:28:02.772476 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.772462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:28:02.772535 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.772499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:28:02.778208 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.778186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt"] Jun 14 20:28:02.818539 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.818512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.818669 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.818559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lrjf\" (UniqueName: \"kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.818669 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.818631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.826393 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.826365 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:02.899291 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.899260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:02.919949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.919928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.920036 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.919963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lrjf\" (UniqueName: \"kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.920036 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.920015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.920398 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.920376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.920398 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.920390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:02.929594 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:02.929574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lrjf\" (UniqueName: \"kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:03.078757 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.078725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:03.215887 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.215857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt"] Jun 14 20:28:03.217677 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:28:03.217650 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d43a3d_d671_4fee_b9a0_6e49d88f163d.slice/crio-932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb WatchSource:0}: Error finding container 932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb: Status 404 returned error can't find the container with id 932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb Jun 14 20:28:03.503067 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.503001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:28:03.504567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.504546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:28:03.535694 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.535665 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:03.854290 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.854256 2576 generic.go:356] "Generic (PLEG): container finished" podID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerID="ff62fee0278da127aff4c3e53f5d97fc0fce33f780a6f5c123955f067978f447" exitCode=0 Jun 14 20:28:03.856621 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.854344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" event={"ID":"97d43a3d-d671-4fee-b9a0-6e49d88f163d","Type":"ContainerDied","Data":"ff62fee0278da127aff4c3e53f5d97fc0fce33f780a6f5c123955f067978f447"} Jun 14 20:28:03.856621 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:03.854391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" event={"ID":"97d43a3d-d671-4fee-b9a0-6e49d88f163d","Type":"ContainerStarted","Data":"932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb"} Jun 14 20:28:04.648118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:04.648072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:04.861406 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:04.861375 2576 generic.go:356] "Generic (PLEG): container finished" podID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerID="4275d1612d0e6a6366ba9f394e018c249f0d9b14eeec011fd079bb4b1f95abd3" exitCode=0 Jun 14 20:28:04.861804 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:04.861422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" event={"ID":"97d43a3d-d671-4fee-b9a0-6e49d88f163d","Type":"ContainerDied","Data":"4275d1612d0e6a6366ba9f394e018c249f0d9b14eeec011fd079bb4b1f95abd3"} Jun 14 20:28:05.868178 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:05.868126 2576 generic.go:356] "Generic (PLEG): container finished" podID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerID="01f986d657343dda55047cc54a5adc0b2869803e87a535381d887f3875f94df9" exitCode=0 Jun 14 20:28:05.868559 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:05.868216 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" event={"ID":"97d43a3d-d671-4fee-b9a0-6e49d88f163d","Type":"ContainerDied","Data":"01f986d657343dda55047cc54a5adc0b2869803e87a535381d887f3875f94df9"} Jun 14 20:28:07.004579 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.004553 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:07.052860 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.052835 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle\") pod \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " Jun 14 20:28:07.052976 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.052935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lrjf\" (UniqueName: \"kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf\") pod \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " Jun 14 20:28:07.052976 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.052954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util\") pod \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\" (UID: \"97d43a3d-d671-4fee-b9a0-6e49d88f163d\") " Jun 14 20:28:07.053801 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.053772 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle" (OuterVolumeSpecName: "bundle") pod "97d43a3d-d671-4fee-b9a0-6e49d88f163d" (UID: "97d43a3d-d671-4fee-b9a0-6e49d88f163d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:28:07.054921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.054899 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf" (OuterVolumeSpecName: "kube-api-access-5lrjf") pod "97d43a3d-d671-4fee-b9a0-6e49d88f163d" (UID: "97d43a3d-d671-4fee-b9a0-6e49d88f163d"). InnerVolumeSpecName "kube-api-access-5lrjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:28:07.059237 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.059213 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util" (OuterVolumeSpecName: "util") pod "97d43a3d-d671-4fee-b9a0-6e49d88f163d" (UID: "97d43a3d-d671-4fee-b9a0-6e49d88f163d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:28:07.154490 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.154413 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lrjf\" (UniqueName: \"kubernetes.io/projected/97d43a3d-d671-4fee-b9a0-6e49d88f163d-kube-api-access-5lrjf\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:28:07.154490 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.154451 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:28:07.154490 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.154465 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97d43a3d-d671-4fee-b9a0-6e49d88f163d-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:28:07.879615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.879589 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" Jun 14 20:28:07.879615 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.879605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4tjtt" event={"ID":"97d43a3d-d671-4fee-b9a0-6e49d88f163d","Type":"ContainerDied","Data":"932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb"} Jun 14 20:28:07.879834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:07.879649 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="932fbf1caaf3a90e29fd674ad6525456c5343b066f2e16b7aa43f42d120c31bb" Jun 14 20:28:12.902963 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:12.902921 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:13.925712 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:13.925678 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:15.192408 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:15.192377 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:15.292830 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:15.292800 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:16.570568 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:16.570537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:16.670077 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:16.670047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:16.871244 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:16.871163 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:17.090908 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:17.090872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:17.208891 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:17.208813 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:21.080665 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:21.080631 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:46.272329 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:46.272286 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:46.369920 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:46.369884 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:28:46.469902 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:28:46.469872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:00.897199 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:00.897165 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:00.997549 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:00.997510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:01.725102 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725058 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b"] Jun 14 20:29:01.725499 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725481 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="util" Jun 14 20:29:01.725593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725501 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="util" Jun 14 20:29:01.725593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725546 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="extract" Jun 14 20:29:01.725593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725556 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="extract" Jun 14 20:29:01.725593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725572 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="pull" Jun 14 20:29:01.725593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725581 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="pull" Jun 14 20:29:01.725843 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.725674 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97d43a3d-d671-4fee-b9a0-6e49d88f163d" containerName="extract" Jun 14 20:29:01.728945 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.728924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.732773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.732745 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 20:29:01.732875 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.732837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nf6l4\"" Jun 14 20:29:01.733871 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.733841 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 20:29:01.736520 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.736499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b"] Jun 14 20:29:01.795899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.795871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.796048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.795916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmjnt\" (UniqueName: \"kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.796048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.795960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.896531 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.896500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmjnt\" (UniqueName: \"kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.896677 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.896567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.896677 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.896602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.896969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.896949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.897020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.896989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:01.905921 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:01.905896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmjnt\" (UniqueName: \"kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:02.040570 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.040499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:02.184515 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.184482 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b"] Jun 14 20:29:02.187297 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:02.187261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5162cff9_8e37_4883_9614_b88f5e9f5202.slice/crio-7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3 WatchSource:0}: Error finding container 7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3: Status 404 returned error can't find the container with id 7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3 Jun 14 20:29:02.320133 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.320105 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52"] Jun 14 20:29:02.323593 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.323575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.330609 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.330586 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52"] Jun 14 20:29:02.402164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.402126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.402270 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.402249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.402320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.402279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgxl\" (UniqueName: \"kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.502904 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.502881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.503027 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.502912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgxl\" (UniqueName: \"kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.503027 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.502947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.503270 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.503252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.503336 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.503319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.510678 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.510659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgxl\" (UniqueName: \"kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.668233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.668163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:02.793850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.793822 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52"] Jun 14 20:29:02.795384 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:02.795358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749e8308_a970_463a_9b84_558f1a696c2e.slice/crio-8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0 WatchSource:0}: Error finding container 8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0: Status 404 returned error can't find the container with id 8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0 Jun 14 20:29:02.919492 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.919435 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk"] Jun 14 20:29:02.922809 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.922794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:02.930048 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:02.930026 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk"] Jun 14 20:29:03.008844 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.008821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.008955 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.008887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.009031 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.009013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgl5t\" (UniqueName: \"kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.039972 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.039947 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:03.110153 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.110128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgl5t\" (UniqueName: \"kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.110239 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.110178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.110239 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.110199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.110508 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.110491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.110545 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.110524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.117946 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.117917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgl5t\" (UniqueName: \"kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.165020 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.164991 2576 generic.go:356] "Generic (PLEG): container finished" podID="749e8308-a970-463a-9b84-558f1a696c2e" containerID="ecffba84871637b963e2489be154e9494cdb165355a45d95d9c5f2a04809afa7" exitCode=0 Jun 14 20:29:03.165105 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.165077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" event={"ID":"749e8308-a970-463a-9b84-558f1a696c2e","Type":"ContainerDied","Data":"ecffba84871637b963e2489be154e9494cdb165355a45d95d9c5f2a04809afa7"} Jun 14 20:29:03.165183 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.165123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" event={"ID":"749e8308-a970-463a-9b84-558f1a696c2e","Type":"ContainerStarted","Data":"8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0"} Jun 14 20:29:03.165568 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.165553 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 20:29:03.166672 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.166648 2576 generic.go:356] "Generic (PLEG): container finished" podID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerID="b967a53624a3736b6d8edae5205419a87032240427fe00ec3b4a813c79fb5968" exitCode=0 Jun 14 20:29:03.166749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.166687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" event={"ID":"5162cff9-8e37-4883-9614-b88f5e9f5202","Type":"ContainerDied","Data":"b967a53624a3736b6d8edae5205419a87032240427fe00ec3b4a813c79fb5968"} Jun 14 20:29:03.166749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.166716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" event={"ID":"5162cff9-8e37-4883-9614-b88f5e9f5202","Type":"ContainerStarted","Data":"7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3"} Jun 14 20:29:03.249013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.248945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:03.323282 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.323250 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx"] Jun 14 20:29:03.327858 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.327839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.333113 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.333087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx"] Jun 14 20:29:03.383737 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.383702 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk"] Jun 14 20:29:03.384995 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:03.384968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bd1734_3f9d_40a6_9639_b8edc5c03cdd.slice/crio-acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8 WatchSource:0}: Error finding container acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8: Status 404 returned error can't find the container with id acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8 Jun 14 20:29:03.412698 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.412668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.412789 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.412709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.412838 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.412788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8mn\" (UniqueName: \"kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.513236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.513175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8mn\" (UniqueName: \"kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.513236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.513233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.513406 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.513347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.513609 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.513593 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.513651 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.513643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.523561 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.523539 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8mn\" (UniqueName: \"kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.639410 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.639386 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:03.812401 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:03.812373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx"] Jun 14 20:29:03.873449 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:03.873419 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86023695_364e_4aa9_a6c6_4b138cdd27d9.slice/crio-599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a WatchSource:0}: Error finding container 599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a: Status 404 returned error can't find the container with id 599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a Jun 14 20:29:04.174088 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.174060 2576 generic.go:356] "Generic (PLEG): container finished" podID="749e8308-a970-463a-9b84-558f1a696c2e" containerID="c3520f237935feb586e90ee22f29492eb6ee23d7c53a7e0e0316c2901f96ae4a" exitCode=0 Jun 14 20:29:04.174449 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.174140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" event={"ID":"749e8308-a970-463a-9b84-558f1a696c2e","Type":"ContainerDied","Data":"c3520f237935feb586e90ee22f29492eb6ee23d7c53a7e0e0316c2901f96ae4a"} Jun 14 20:29:04.175730 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.175709 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerID="91cf396163a566663233a5a3ea7959928d89838686f154fb901062f35e7da728" exitCode=0 Jun 14 20:29:04.175809 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.175789 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" event={"ID":"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd","Type":"ContainerDied","Data":"91cf396163a566663233a5a3ea7959928d89838686f154fb901062f35e7da728"} Jun 14 20:29:04.175862 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.175835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" event={"ID":"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd","Type":"ContainerStarted","Data":"acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8"} Jun 14 20:29:04.177710 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.177685 2576 generic.go:356] "Generic (PLEG): container finished" podID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerID="6b8a7390d1886cec5bc03d37e66ddd62ca5d94ed8592aab836752fbaef92ff4f" exitCode=0 Jun 14 20:29:04.177799 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.177751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" event={"ID":"5162cff9-8e37-4883-9614-b88f5e9f5202","Type":"ContainerDied","Data":"6b8a7390d1886cec5bc03d37e66ddd62ca5d94ed8592aab836752fbaef92ff4f"} Jun 14 20:29:04.179746 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.179271 2576 generic.go:356] "Generic (PLEG): container finished" podID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerID="63cc4e3d601a77225ffef407e9d6a6e50f28c3412af2a56a10e030a90f96133f" exitCode=0 Jun 14 20:29:04.179746 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.179322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" event={"ID":"86023695-364e-4aa9-a6c6-4b138cdd27d9","Type":"ContainerDied","Data":"63cc4e3d601a77225ffef407e9d6a6e50f28c3412af2a56a10e030a90f96133f"} Jun 14 20:29:04.179746 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:04.179352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" event={"ID":"86023695-364e-4aa9-a6c6-4b138cdd27d9","Type":"ContainerStarted","Data":"599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a"} Jun 14 20:29:05.187831 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.187747 2576 generic.go:356] "Generic (PLEG): container finished" podID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerID="56772dcfac551b15ee16188c538c566b55ef8290c5096e43ec3f9482ed45e06f" exitCode=0 Jun 14 20:29:05.188209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.187832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" event={"ID":"5162cff9-8e37-4883-9614-b88f5e9f5202","Type":"ContainerDied","Data":"56772dcfac551b15ee16188c538c566b55ef8290c5096e43ec3f9482ed45e06f"} Jun 14 20:29:05.189571 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.189549 2576 generic.go:356] "Generic (PLEG): container finished" podID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerID="9f9f6dabbe7d1d0d620ab11f2e1b00e8c7ec938d3de7cdb973d5979467fcab39" exitCode=0 Jun 14 20:29:05.189672 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.189619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" event={"ID":"86023695-364e-4aa9-a6c6-4b138cdd27d9","Type":"ContainerDied","Data":"9f9f6dabbe7d1d0d620ab11f2e1b00e8c7ec938d3de7cdb973d5979467fcab39"} Jun 14 20:29:05.192071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.192048 2576 generic.go:356] "Generic (PLEG): container finished" podID="749e8308-a970-463a-9b84-558f1a696c2e" containerID="4b95aff69a2c68bb9e8bb836f9153838538f83752a1e8f1ec140d516a4a4ef38" exitCode=0 Jun 14 20:29:05.192180 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.192113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" event={"ID":"749e8308-a970-463a-9b84-558f1a696c2e","Type":"ContainerDied","Data":"4b95aff69a2c68bb9e8bb836f9153838538f83752a1e8f1ec140d516a4a4ef38"} Jun 14 20:29:05.193836 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.193816 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerID="90491b187daa46d66d6eb16a1c36468ac042f99f828b4611c5aa8540fab1eeea" exitCode=0 Jun 14 20:29:05.193906 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:05.193854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" event={"ID":"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd","Type":"ContainerDied","Data":"90491b187daa46d66d6eb16a1c36468ac042f99f828b4611c5aa8540fab1eeea"} Jun 14 20:29:06.200637 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.200560 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerID="6ba8b49ab6f2d9d1ec1e15103e0c273bb487ff26ae4d73da9c62d28b7545933b" exitCode=0 Jun 14 20:29:06.201105 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.200645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" event={"ID":"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd","Type":"ContainerDied","Data":"6ba8b49ab6f2d9d1ec1e15103e0c273bb487ff26ae4d73da9c62d28b7545933b"} Jun 14 20:29:06.202703 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.202684 2576 generic.go:356] "Generic (PLEG): container finished" podID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerID="f3b548a6d4d9d451ea65095a00f5873fef07efb8f11511bfd74f0d20a9302a7f" exitCode=0 Jun 14 20:29:06.202807 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.202769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" event={"ID":"86023695-364e-4aa9-a6c6-4b138cdd27d9","Type":"ContainerDied","Data":"f3b548a6d4d9d451ea65095a00f5873fef07efb8f11511bfd74f0d20a9302a7f"} Jun 14 20:29:06.355819 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.355796 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:06.359326 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.359310 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:06.441050 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle\") pod \"5162cff9-8e37-4883-9614-b88f5e9f5202\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " Jun 14 20:29:06.441236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle\") pod \"749e8308-a970-463a-9b84-558f1a696c2e\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " Jun 14 20:29:06.441236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441092 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmjnt\" (UniqueName: \"kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt\") pod \"5162cff9-8e37-4883-9614-b88f5e9f5202\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " Jun 14 20:29:06.441236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441116 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhgxl\" (UniqueName: \"kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl\") pod \"749e8308-a970-463a-9b84-558f1a696c2e\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " Jun 14 20:29:06.441236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441139 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util\") pod \"5162cff9-8e37-4883-9614-b88f5e9f5202\" (UID: \"5162cff9-8e37-4883-9614-b88f5e9f5202\") " Jun 14 20:29:06.441236 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441175 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util\") pod \"749e8308-a970-463a-9b84-558f1a696c2e\" (UID: \"749e8308-a970-463a-9b84-558f1a696c2e\") " Jun 14 20:29:06.441639 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle" (OuterVolumeSpecName: "bundle") pod "749e8308-a970-463a-9b84-558f1a696c2e" (UID: "749e8308-a970-463a-9b84-558f1a696c2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:06.441711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.441670 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle" (OuterVolumeSpecName: "bundle") pod "5162cff9-8e37-4883-9614-b88f5e9f5202" (UID: "5162cff9-8e37-4883-9614-b88f5e9f5202"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:06.443412 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.443383 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl" (OuterVolumeSpecName: "kube-api-access-lhgxl") pod "749e8308-a970-463a-9b84-558f1a696c2e" (UID: "749e8308-a970-463a-9b84-558f1a696c2e"). InnerVolumeSpecName "kube-api-access-lhgxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:29:06.443780 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.443759 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt" (OuterVolumeSpecName: "kube-api-access-pmjnt") pod "5162cff9-8e37-4883-9614-b88f5e9f5202" (UID: "5162cff9-8e37-4883-9614-b88f5e9f5202"). InnerVolumeSpecName "kube-api-access-pmjnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:29:06.447305 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.447280 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util" (OuterVolumeSpecName: "util") pod "5162cff9-8e37-4883-9614-b88f5e9f5202" (UID: "5162cff9-8e37-4883-9614-b88f5e9f5202"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:06.447379 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.447349 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util" (OuterVolumeSpecName: "util") pod "749e8308-a970-463a-9b84-558f1a696c2e" (UID: "749e8308-a970-463a-9b84-558f1a696c2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541791 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmjnt\" (UniqueName: \"kubernetes.io/projected/5162cff9-8e37-4883-9614-b88f5e9f5202-kube-api-access-pmjnt\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541814 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhgxl\" (UniqueName: \"kubernetes.io/projected/749e8308-a970-463a-9b84-558f1a696c2e-kube-api-access-lhgxl\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541824 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541834 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541841 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5162cff9-8e37-4883-9614-b88f5e9f5202-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:06.541848 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:06.541849 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/749e8308-a970-463a-9b84-558f1a696c2e-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.209097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.209067 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" Jun 14 20:29:07.209097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.209082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b" event={"ID":"5162cff9-8e37-4883-9614-b88f5e9f5202","Type":"ContainerDied","Data":"7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3"} Jun 14 20:29:07.209609 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.209135 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d50a14b6a39de2431cb2c26a3eb0cfb38ed79e29dca0963921bd0653dca91c3" Jun 14 20:29:07.211099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.211079 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" Jun 14 20:29:07.211249 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.211113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52" event={"ID":"749e8308-a970-463a-9b84-558f1a696c2e","Type":"ContainerDied","Data":"8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0"} Jun 14 20:29:07.211249 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.211179 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ce017049ee9cc78bf9cde547df3c91caec3531282db8c96007cd0b49e327ff0" Jun 14 20:29:07.341901 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.341871 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:07.372296 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.372272 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:07.448979 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.448954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util\") pod \"86023695-364e-4aa9-a6c6-4b138cdd27d9\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " Jun 14 20:29:07.448979 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.448982 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle\") pod \"86023695-364e-4aa9-a6c6-4b138cdd27d9\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " Jun 14 20:29:07.449233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449028 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util\") pod \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " Jun 14 20:29:07.449233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449054 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle\") pod \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " Jun 14 20:29:07.449233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449085 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgl5t\" (UniqueName: \"kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t\") pod \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\" (UID: \"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd\") " Jun 14 20:29:07.449233 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449107 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r8mn\" (UniqueName: \"kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn\") pod \"86023695-364e-4aa9-a6c6-4b138cdd27d9\" (UID: \"86023695-364e-4aa9-a6c6-4b138cdd27d9\") " Jun 14 20:29:07.449681 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449653 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle" (OuterVolumeSpecName: "bundle") pod "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" (UID: "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:07.449800 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.449726 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle" (OuterVolumeSpecName: "bundle") pod "86023695-364e-4aa9-a6c6-4b138cdd27d9" (UID: "86023695-364e-4aa9-a6c6-4b138cdd27d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:07.451331 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.451306 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn" (OuterVolumeSpecName: "kube-api-access-8r8mn") pod "86023695-364e-4aa9-a6c6-4b138cdd27d9" (UID: "86023695-364e-4aa9-a6c6-4b138cdd27d9"). InnerVolumeSpecName "kube-api-access-8r8mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:29:07.451419 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.451331 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t" (OuterVolumeSpecName: "kube-api-access-sgl5t") pod "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" (UID: "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd"). InnerVolumeSpecName "kube-api-access-sgl5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:29:07.454949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.454925 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util" (OuterVolumeSpecName: "util") pod "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" (UID: "e4bd1734-3f9d-40a6-9639-b8edc5c03cdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:07.455010 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.454980 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util" (OuterVolumeSpecName: "util") pod "86023695-364e-4aa9-a6c6-4b138cdd27d9" (UID: "86023695-364e-4aa9-a6c6-4b138cdd27d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:29:07.549808 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549786 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.549808 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549810 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgl5t\" (UniqueName: \"kubernetes.io/projected/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-kube-api-access-sgl5t\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.549988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549822 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r8mn\" (UniqueName: \"kubernetes.io/projected/86023695-364e-4aa9-a6c6-4b138cdd27d9-kube-api-access-8r8mn\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.549988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549831 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.549988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549840 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86023695-364e-4aa9-a6c6-4b138cdd27d9-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:07.549988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:07.549847 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4bd1734-3f9d-40a6-9639-b8edc5c03cdd-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:29:08.218470 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.218393 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" Jun 14 20:29:08.218470 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.218424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk" event={"ID":"e4bd1734-3f9d-40a6-9639-b8edc5c03cdd","Type":"ContainerDied","Data":"acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8"} Jun 14 20:29:08.218910 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.218469 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acc3cb54d93e102c12c2ff781513cdf48749b8aa3c81949b647aa519a6e37db8" Jun 14 20:29:08.220451 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.220424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" event={"ID":"86023695-364e-4aa9-a6c6-4b138cdd27d9","Type":"ContainerDied","Data":"599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a"} Jun 14 20:29:08.220591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.220467 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx" Jun 14 20:29:08.220652 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:08.220468 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="599d4fae45857da4d32d67e702cc1f2ba46f414923ea86fb9f9c5f49c1a10d5a" Jun 14 20:29:09.367104 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:09.367074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:09.809890 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:09.809855 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:09.902963 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:09.902932 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:13.860049 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:13.860014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:16.975485 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:16.975451 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:19.982567 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:19.982535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:20.571203 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:20.571158 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:20.993027 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:20.992934 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:21.099130 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:21.099093 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:21.193950 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:21.193907 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:24.190573 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:24.190537 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:24.450112 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:24.450020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:24.552547 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:24.552512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:25.979263 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979224 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc"] Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979564 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="extract" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979575 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="extract" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979595 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="pull" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979602 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="pull" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979609 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="extract" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979615 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="extract" Jun 14 20:29:25.979622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979622 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979628 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979635 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979640 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979646 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979651 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979658 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979663 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979669 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979675 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979681 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979687 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979694 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979699 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979707 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979712 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="util" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979717 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979721 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="pull" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979777 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="749e8308-a970-463a-9b84-558f1a696c2e" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979786 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86023695-364e-4aa9-a6c6-4b138cdd27d9" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979791 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5162cff9-8e37-4883-9614-b88f5e9f5202" containerName="extract" Jun 14 20:29:25.979834 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.979796 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bd1734-3f9d-40a6-9639-b8edc5c03cdd" containerName="extract" Jun 14 20:29:25.982690 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.982674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:25.984990 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.984969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 20:29:25.985139 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.985123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nf6l4\"" Jun 14 20:29:25.985953 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.985930 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 20:29:25.986028 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.985972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 20:29:25.986028 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.985973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 20:29:25.990666 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.990645 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:25.991676 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:25.991657 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc"] Jun 14 20:29:26.101586 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.101562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dscgm\" (UniqueName: \"kubernetes.io/projected/61584d59-8922-425f-bf71-48fe8836db10-kube-api-access-dscgm\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.101713 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.101599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.101713 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.101632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61584d59-8922-425f-bf71-48fe8836db10-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.202900 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.202875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dscgm\" (UniqueName: \"kubernetes.io/projected/61584d59-8922-425f-bf71-48fe8836db10-kube-api-access-dscgm\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.203014 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.202910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.203014 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.202930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61584d59-8922-425f-bf71-48fe8836db10-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.203093 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:29:26.203020 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 14 20:29:26.203127 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:29:26.203093 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert podName:61584d59-8922-425f-bf71-48fe8836db10 nodeName:}" failed. No retries permitted until 2026-06-14 20:29:26.703075961 +0000 UTC m=+683.572855402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-5nrrc" (UID: "61584d59-8922-425f-bf71-48fe8836db10") : secret "plugin-serving-cert" not found Jun 14 20:29:26.203485 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.203470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61584d59-8922-425f-bf71-48fe8836db10-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.211234 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.211216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dscgm\" (UniqueName: \"kubernetes.io/projected/61584d59-8922-425f-bf71-48fe8836db10-kube-api-access-dscgm\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.525643 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.525613 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:26.626617 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.626588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:26.707285 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.707255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.709542 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.709521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61584d59-8922-425f-bf71-48fe8836db10-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5nrrc\" (UID: \"61584d59-8922-425f-bf71-48fe8836db10\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.784538 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.784464 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b"] Jun 14 20:29:26.787974 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.787958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:26.791665 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.791645 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gr9cq\"" Jun 14 20:29:26.791665 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.791656 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 14 20:29:26.800612 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.800592 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b"] Jun 14 20:29:26.893006 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.892978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" Jun 14 20:29:26.909628 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:26.909600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjmxn\" (UniqueName: \"kubernetes.io/projected/46c9eaff-e484-4ae7-9eca-38ea71bdd30a-kube-api-access-jjmxn\") pod \"dns-operator-controller-manager-864dd78c4c-bpk5b\" (UID: \"46c9eaff-e484-4ae7-9eca-38ea71bdd30a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:27.010511 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.010468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjmxn\" (UniqueName: \"kubernetes.io/projected/46c9eaff-e484-4ae7-9eca-38ea71bdd30a-kube-api-access-jjmxn\") pod \"dns-operator-controller-manager-864dd78c4c-bpk5b\" (UID: \"46c9eaff-e484-4ae7-9eca-38ea71bdd30a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:27.023479 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.023453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjmxn\" (UniqueName: \"kubernetes.io/projected/46c9eaff-e484-4ae7-9eca-38ea71bdd30a-kube-api-access-jjmxn\") pod \"dns-operator-controller-manager-864dd78c4c-bpk5b\" (UID: \"46c9eaff-e484-4ae7-9eca-38ea71bdd30a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:27.044659 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.044633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc"] Jun 14 20:29:27.046548 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:27.046524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61584d59_8922_425f_bf71_48fe8836db10.slice/crio-09585d2b795347bfb301d43cc00628fa01cd313faf396cf0f8863e9c5b136d2e WatchSource:0}: Error finding container 09585d2b795347bfb301d43cc00628fa01cd313faf396cf0f8863e9c5b136d2e: Status 404 returned error can't find the container with id 09585d2b795347bfb301d43cc00628fa01cd313faf396cf0f8863e9c5b136d2e Jun 14 20:29:27.098445 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.098391 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:27.246427 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.246403 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b"] Jun 14 20:29:27.247960 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:27.247928 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c9eaff_e484_4ae7_9eca_38ea71bdd30a.slice/crio-e3b2b6bc0233d92e17fe9c4099f03ca8a67730dea81dc67ad152b45d6876c069 WatchSource:0}: Error finding container e3b2b6bc0233d92e17fe9c4099f03ca8a67730dea81dc67ad152b45d6876c069: Status 404 returned error can't find the container with id e3b2b6bc0233d92e17fe9c4099f03ca8a67730dea81dc67ad152b45d6876c069 Jun 14 20:29:27.324892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.324823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" event={"ID":"61584d59-8922-425f-bf71-48fe8836db10","Type":"ContainerStarted","Data":"09585d2b795347bfb301d43cc00628fa01cd313faf396cf0f8863e9c5b136d2e"} Jun 14 20:29:27.326018 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:27.325994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" event={"ID":"46c9eaff-e484-4ae7-9eca-38ea71bdd30a","Type":"ContainerStarted","Data":"e3b2b6bc0233d92e17fe9c4099f03ca8a67730dea81dc67ad152b45d6876c069"} Jun 14 20:29:28.809975 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:28.809937 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:29.577294 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:29.577256 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:29.635135 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:29.635092 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:30.349339 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:30.349308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" event={"ID":"46c9eaff-e484-4ae7-9eca-38ea71bdd30a","Type":"ContainerStarted","Data":"d307bda19adb2d2a037758c2611de94181f8330ffcf45dbfafa2f0da479f4834"} Jun 14 20:29:30.349705 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:30.349396 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:30.367934 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:30.367879 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" podStartSLOduration=2.207979995 podStartE2EDuration="4.367859786s" totalImagesPullingTime="2.159879791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:29:30.364831889 +0000 UTC m=+687.234611556" watchObservedRunningTime="2026-06-14 20:29:30.367859786 +0000 UTC m=+687.237639218" Jun 14 20:29:36.417595 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.417558 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s"] Jun 14 20:29:36.430056 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.430031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:36.432900 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.432711 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8q5wp\"" Jun 14 20:29:36.435936 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.435717 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s"] Jun 14 20:29:36.501073 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.501041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2db45\" (UniqueName: \"kubernetes.io/projected/a433958c-bfb0-4965-aff8-b1400a01683b-kube-api-access-2db45\") pod \"limitador-operator-controller-manager-859d7b78bd-4lg4s\" (UID: \"a433958c-bfb0-4965-aff8-b1400a01683b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:36.602773 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.602533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2db45\" (UniqueName: \"kubernetes.io/projected/a433958c-bfb0-4965-aff8-b1400a01683b-kube-api-access-2db45\") pod \"limitador-operator-controller-manager-859d7b78bd-4lg4s\" (UID: \"a433958c-bfb0-4965-aff8-b1400a01683b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:36.613221 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.613194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2db45\" (UniqueName: \"kubernetes.io/projected/a433958c-bfb0-4965-aff8-b1400a01683b-kube-api-access-2db45\") pod \"limitador-operator-controller-manager-859d7b78bd-4lg4s\" (UID: \"a433958c-bfb0-4965-aff8-b1400a01683b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:36.744970 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:36.744888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:37.009980 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:37.009873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:37.119118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:37.115056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:41.357003 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:41.356966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpk5b" Jun 14 20:29:41.394627 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:41.394589 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:41.501349 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:41.501304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:43.847493 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:43.847449 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:43.946706 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:43.946653 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:48.922473 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:48.922437 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s"] Jun 14 20:29:48.924112 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:29:48.924088 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda433958c_bfb0_4965_aff8_b1400a01683b.slice/crio-414b096c49f7ade0bad40b79b246c9611c82e15737aa4308fe62877a82660073 WatchSource:0}: Error finding container 414b096c49f7ade0bad40b79b246c9611c82e15737aa4308fe62877a82660073: Status 404 returned error can't find the container with id 414b096c49f7ade0bad40b79b246c9611c82e15737aa4308fe62877a82660073 Jun 14 20:29:49.388413 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.388386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:49.437856 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.437829 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:49.474752 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.474724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" event={"ID":"61584d59-8922-425f-bf71-48fe8836db10","Type":"ContainerStarted","Data":"432818ac0fff1a7c52b8a8ccbc136744c9cf01531786ee73580000029c7d4e77"} Jun 14 20:29:49.476028 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.476005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" event={"ID":"a433958c-bfb0-4965-aff8-b1400a01683b","Type":"ContainerStarted","Data":"414b096c49f7ade0bad40b79b246c9611c82e15737aa4308fe62877a82660073"} Jun 14 20:29:49.489883 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.489839 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5nrrc" podStartSLOduration=2.66551764 podStartE2EDuration="24.489826397s" totalImagesPullingTime="21.824308757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:29:49.48891416 +0000 UTC m=+706.358693604" watchObservedRunningTime="2026-06-14 20:29:49.489826397 +0000 UTC m=+706.359605871" Jun 14 20:29:49.733209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:49.733110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:51.498711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:51.498641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:29:51.498711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:51.498688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" event={"ID":"a433958c-bfb0-4965-aff8-b1400a01683b","Type":"ContainerStarted","Data":"f29ac7be5a86f8ad950079c3d30b4a07c7d8fc9ceed37a522df2b2f86ae49ef4"} Jun 14 20:29:51.510343 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:51.510299 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" podStartSLOduration=13.923940356 podStartE2EDuration="15.510284946s" totalImagesPullingTime="1.58634459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:29:51.509223997 +0000 UTC m=+708.379003450" watchObservedRunningTime="2026-06-14 20:29:51.510284946 +0000 UTC m=+708.380064423" Jun 14 20:29:56.274190 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:56.274125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:29:56.374541 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:29:56.374505 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:01.108284 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:01.108252 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:01.205455 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:01.205411 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:02.502130 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:02.502100 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4lg4s" Jun 14 20:30:03.530893 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:03.530847 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:03.581357 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:03.581317 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:09.276585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:09.276550 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:09.337182 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:09.337132 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:09.513918 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:09.513888 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:10.059503 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:10.059474 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:11.072867 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.072830 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:11.165559 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.165513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:11.268065 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.268038 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:11.835271 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.835238 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:11.867500 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.867468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:11.876489 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.876466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:11.876610 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.876550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:11.879013 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.878994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nmmzl\"" Jun 14 20:30:11.972141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:11.972111 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:12.005814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.005781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlmjq\" (UniqueName: \"kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq\") pod \"authorino-58cd955675-9mnhr\" (UID: \"2cf34923-37ab-4245-b1eb-9f2359fe24fd\") " pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:12.106627 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.106560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlmjq\" (UniqueName: \"kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq\") pod \"authorino-58cd955675-9mnhr\" (UID: \"2cf34923-37ab-4245-b1eb-9f2359fe24fd\") " pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:12.114641 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.114616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlmjq\" (UniqueName: \"kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq\") pod \"authorino-58cd955675-9mnhr\" (UID: \"2cf34923-37ab-4245-b1eb-9f2359fe24fd\") " pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:12.185027 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.185003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:12.311367 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.311338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:12.312424 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:30:12.312396 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cf34923_37ab_4245_b1eb_9f2359fe24fd.slice/crio-9ecc851cc5b02e2cb14baff5bd0865f2cf992a75365e8efe9664e686e302178a WatchSource:0}: Error finding container 9ecc851cc5b02e2cb14baff5bd0865f2cf992a75365e8efe9664e686e302178a: Status 404 returned error can't find the container with id 9ecc851cc5b02e2cb14baff5bd0865f2cf992a75365e8efe9664e686e302178a Jun 14 20:30:12.612669 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.612637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9mnhr" event={"ID":"2cf34923-37ab-4245-b1eb-9f2359fe24fd","Type":"ContainerStarted","Data":"9ecc851cc5b02e2cb14baff5bd0865f2cf992a75365e8efe9664e686e302178a"} Jun 14 20:30:12.811631 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:12.811603 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:15.633572 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:15.633537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9mnhr" event={"ID":"2cf34923-37ab-4245-b1eb-9f2359fe24fd","Type":"ContainerStarted","Data":"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b"} Jun 14 20:30:15.649040 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:15.648993 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9mnhr" podStartSLOduration=1.4868323430000001 podStartE2EDuration="4.648978068s" totalImagesPullingTime="3.162145725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:30:15.646468831 +0000 UTC m=+732.516248261" watchObservedRunningTime="2026-06-14 20:30:15.648978068 +0000 UTC m=+732.518757498" Jun 14 20:30:16.678860 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:16.678826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:16.781072 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:16.781039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:17.158390 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:17.158361 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:17.644192 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:17.644136 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9mnhr" podUID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" containerName="authorino" containerID="cri-o://7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b" gracePeriod=30 Jun 14 20:30:17.891174 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:17.891129 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:17.950611 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:17.950542 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlmjq\" (UniqueName: \"kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq\") pod \"2cf34923-37ab-4245-b1eb-9f2359fe24fd\" (UID: \"2cf34923-37ab-4245-b1eb-9f2359fe24fd\") " Jun 14 20:30:17.952469 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:17.952446 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq" (OuterVolumeSpecName: "kube-api-access-zlmjq") pod "2cf34923-37ab-4245-b1eb-9f2359fe24fd" (UID: "2cf34923-37ab-4245-b1eb-9f2359fe24fd"). InnerVolumeSpecName "kube-api-access-zlmjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:30:18.051557 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.051522 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlmjq\" (UniqueName: \"kubernetes.io/projected/2cf34923-37ab-4245-b1eb-9f2359fe24fd-kube-api-access-zlmjq\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:30:18.653407 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.653369 2576 generic.go:356] "Generic (PLEG): container finished" podID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" containerID="7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b" exitCode=0 Jun 14 20:30:18.653554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.653417 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9mnhr" Jun 14 20:30:18.653554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.653454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9mnhr" event={"ID":"2cf34923-37ab-4245-b1eb-9f2359fe24fd","Type":"ContainerDied","Data":"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b"} Jun 14 20:30:18.653554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.653493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9mnhr" event={"ID":"2cf34923-37ab-4245-b1eb-9f2359fe24fd","Type":"ContainerDied","Data":"9ecc851cc5b02e2cb14baff5bd0865f2cf992a75365e8efe9664e686e302178a"} Jun 14 20:30:18.653554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.653513 2576 scope.go:117] "RemoveContainer" containerID="7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b" Jun 14 20:30:18.662342 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.662320 2576 scope.go:117] "RemoveContainer" containerID="7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b" Jun 14 20:30:18.662581 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:30:18.662560 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b\": container with ID starting with 7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b not found: ID does not exist" containerID="7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b" Jun 14 20:30:18.662629 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.662588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b"} err="failed to get container status \"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b\": rpc error: code = NotFound desc = could not find container \"7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b\": container with ID starting with 7b1aa546a73cfd97e032313c1d25097093b9fc2da3fec267d9d26c1918cf260b not found: ID does not exist" Jun 14 20:30:18.673697 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.673667 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:18.678809 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:18.678788 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9mnhr"] Jun 14 20:30:19.499325 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:19.499291 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" path="/var/lib/kubelet/pods/2cf34923-37ab-4245-b1eb-9f2359fe24fd/volumes" Jun 14 20:30:21.284402 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:21.284366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:21.403078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:21.403048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:23.733945 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:23.733915 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:23.833610 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:23.833580 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:30.337381 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:30.337348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:30.438104 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:30.438075 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:32.564355 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:32.564298 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:42.538977 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:42.538948 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:42.642681 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:42.642656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:42.774465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:42.774395 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:30:43.663507 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.663463 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7"] Jun 14 20:30:43.663972 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.663955 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" containerName="authorino" Jun 14 20:30:43.663972 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.663971 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" containerName="authorino" Jun 14 20:30:43.664084 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.664063 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf34923-37ab-4245-b1eb-9f2359fe24fd" containerName="authorino" Jun 14 20:30:43.687196 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.684373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7"] Jun 14 20:30:43.687196 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.684493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.688001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.687682 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-65xhc\"" Jun 14 20:30:43.688001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.687817 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 20:30:43.691378 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.691343 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 20:30:43.747353 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.747324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.747353 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.747356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqh7r\" (UniqueName: \"kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.747511 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.747447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.848130 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.848102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.848301 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.848134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqh7r\" (UniqueName: \"kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.848301 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.848228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.848474 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.848456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.848515 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.848494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:43.856501 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:43.856476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqh7r\" (UniqueName: \"kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:44.002097 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:44.002017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:44.136186 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:44.136159 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7"] Jun 14 20:30:44.137600 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:30:44.137572 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0263d046_307d_4499_976b_e3821a2004cc.slice/crio-4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03 WatchSource:0}: Error finding container 4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03: Status 404 returned error can't find the container with id 4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03 Jun 14 20:30:44.798081 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:44.798045 2576 generic.go:356] "Generic (PLEG): container finished" podID="0263d046-307d-4499-976b-e3821a2004cc" containerID="3a61c883a10bc0b6045236c1fea4389e8b6cd162dd34c77509935252939f70d6" exitCode=0 Jun 14 20:30:44.798464 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:44.798111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" event={"ID":"0263d046-307d-4499-976b-e3821a2004cc","Type":"ContainerDied","Data":"3a61c883a10bc0b6045236c1fea4389e8b6cd162dd34c77509935252939f70d6"} Jun 14 20:30:44.798464 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:44.798179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" event={"ID":"0263d046-307d-4499-976b-e3821a2004cc","Type":"ContainerStarted","Data":"4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03"} Jun 14 20:30:45.805554 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:45.805516 2576 generic.go:356] "Generic (PLEG): container finished" podID="0263d046-307d-4499-976b-e3821a2004cc" containerID="45a9bc3fa3675c5f7ea23c15cbce210818406636a633be2604eda3d2be45079f" exitCode=0 Jun 14 20:30:45.805970 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:45.805602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" event={"ID":"0263d046-307d-4499-976b-e3821a2004cc","Type":"ContainerDied","Data":"45a9bc3fa3675c5f7ea23c15cbce210818406636a633be2604eda3d2be45079f"} Jun 14 20:30:46.813519 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:46.813485 2576 generic.go:356] "Generic (PLEG): container finished" podID="0263d046-307d-4499-976b-e3821a2004cc" containerID="0064dc5c4a6d29a469bd81c3576951c0c1f87fd3cea04f93aeeea10f5f9a6c96" exitCode=0 Jun 14 20:30:46.813878 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:46.813542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" event={"ID":"0263d046-307d-4499-976b-e3821a2004cc","Type":"ContainerDied","Data":"0064dc5c4a6d29a469bd81c3576951c0c1f87fd3cea04f93aeeea10f5f9a6c96"} Jun 14 20:30:47.952996 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:47.952974 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:48.083803 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.083729 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util\") pod \"0263d046-307d-4499-976b-e3821a2004cc\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " Jun 14 20:30:48.083966 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.083816 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqh7r\" (UniqueName: \"kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r\") pod \"0263d046-307d-4499-976b-e3821a2004cc\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " Jun 14 20:30:48.083966 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.083843 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle\") pod \"0263d046-307d-4499-976b-e3821a2004cc\" (UID: \"0263d046-307d-4499-976b-e3821a2004cc\") " Jun 14 20:30:48.084391 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.084365 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle" (OuterVolumeSpecName: "bundle") pod "0263d046-307d-4499-976b-e3821a2004cc" (UID: "0263d046-307d-4499-976b-e3821a2004cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:30:48.085930 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.085897 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r" (OuterVolumeSpecName: "kube-api-access-jqh7r") pod "0263d046-307d-4499-976b-e3821a2004cc" (UID: "0263d046-307d-4499-976b-e3821a2004cc"). InnerVolumeSpecName "kube-api-access-jqh7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:30:48.089905 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.089879 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util" (OuterVolumeSpecName: "util") pod "0263d046-307d-4499-976b-e3821a2004cc" (UID: "0263d046-307d-4499-976b-e3821a2004cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 20:30:48.185059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.185032 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqh7r\" (UniqueName: \"kubernetes.io/projected/0263d046-307d-4499-976b-e3821a2004cc-kube-api-access-jqh7r\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:30:48.185059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.185054 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-bundle\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:30:48.185059 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.185064 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0263d046-307d-4499-976b-e3821a2004cc-util\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:30:48.826485 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.826456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" Jun 14 20:30:48.826727 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.826493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748w4rk7" event={"ID":"0263d046-307d-4499-976b-e3821a2004cc","Type":"ContainerDied","Data":"4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03"} Jun 14 20:30:48.826727 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:30:48.826534 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4efcf080b9c91638d30145e12c2a56e407e5e6bc2ab13cf7d0765d0e41c11a03" Jun 14 20:31:06.114484 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.114454 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:06.215069 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.215039 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:06.516555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516468 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:31:06.516917 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516899 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="extract" Jun 14 20:31:06.517066 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516920 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="extract" Jun 14 20:31:06.517066 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516936 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="pull" Jun 14 20:31:06.517066 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516943 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="pull" Jun 14 20:31:06.517066 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516958 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="util" Jun 14 20:31:06.517066 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.516966 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="util" Jun 14 20:31:06.517365 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.517074 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0263d046-307d-4499-976b-e3821a2004cc" containerName="extract" Jun 14 20:31:06.521336 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.521314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:06.523761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.523737 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 20:31:06.523761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.523756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 20:31:06.524937 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.524914 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 20:31:06.525044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.524950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xjpxd\"" Jun 14 20:31:06.528993 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.528969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:31:06.636611 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.636578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf4wg\" (UniqueName: \"kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg\") pod \"maas-keycloak-0\" (UID: \"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:06.737156 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.737128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf4wg\" (UniqueName: \"kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg\") pod \"maas-keycloak-0\" (UID: \"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:06.747275 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.747256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf4wg\" (UniqueName: \"kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg\") pod \"maas-keycloak-0\" (UID: \"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:06.833002 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.832974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:06.969076 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:06.969045 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:31:06.970386 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:31:06.970361 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42cbc4c_efcb_49d1_90ad_72bd8f8ba6da.slice/crio-e85cfa43793bbe4a32f6869a5c495586c5f73f863325d57bd2902471a06ec1c0 WatchSource:0}: Error finding container e85cfa43793bbe4a32f6869a5c495586c5f73f863325d57bd2902471a06ec1c0: Status 404 returned error can't find the container with id e85cfa43793bbe4a32f6869a5c495586c5f73f863325d57bd2902471a06ec1c0 Jun 14 20:31:07.932543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:07.932499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da","Type":"ContainerStarted","Data":"e85cfa43793bbe4a32f6869a5c495586c5f73f863325d57bd2902471a06ec1c0"} Jun 14 20:31:11.959369 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:11.959325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da","Type":"ContainerStarted","Data":"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0"} Jun 14 20:31:11.980188 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:11.980116 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6488976210000001 podStartE2EDuration="5.980100318s" totalImagesPullingTime="4.331202697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:31:11.976284405 +0000 UTC m=+788.846063856" watchObservedRunningTime="2026-06-14 20:31:11.980100318 +0000 UTC m=+788.849879749" Jun 14 20:31:12.834068 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:12.834027 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:12.835847 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:12.835806 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:13.834454 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:13.834404 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:14.833891 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:14.833843 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:15.834452 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:15.834404 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:16.833868 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:16.833819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:16.834170 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:16.834105 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:17.833583 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:17.833532 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:18.834141 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:18.834090 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:19.834035 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:19.833976 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:20.833915 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:20.833865 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:21.834383 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:21.834331 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:22.833561 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:22.833513 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:23.834079 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:23.834042 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.42:9000/health/started\": dial tcp 10.132.0.42:9000: connect: connection refused" Jun 14 20:31:24.952993 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:24.952954 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:24.969766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:24.969709 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:31:26.283249 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:26.283195 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:34.959294 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:34.959251 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 20:31:35.598431 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.598400 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:35.711472 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.711438 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:35.816635 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.816594 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:35.823980 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.823951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:35.826007 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.825983 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:35.826313 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.826295 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nmmzl\"" Jun 14 20:31:35.905904 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:35.905829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55dmh\" (UniqueName: \"kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh\") pod \"authorino-5d4b67c446-z9lcs\" (UID: \"41d39a62-8592-4ffa-a612-0137f0a24440\") " pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:36.006618 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:36.006586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55dmh\" (UniqueName: \"kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh\") pod \"authorino-5d4b67c446-z9lcs\" (UID: \"41d39a62-8592-4ffa-a612-0137f0a24440\") " pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:36.035907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:36.034766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55dmh\" (UniqueName: \"kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh\") pod \"authorino-5d4b67c446-z9lcs\" (UID: \"41d39a62-8592-4ffa-a612-0137f0a24440\") " pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:36.035907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:36.035167 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:36.035907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:36.035663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:36.175804 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:36.175776 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:36.177200 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:31:36.177171 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41d39a62_8592_4ffa_a612_0137f0a24440.slice/crio-cb84e3018e3a0ca762fd16d033c5f589ad003c4a1338cecc1fe9340f9ad15b39 WatchSource:0}: Error finding container cb84e3018e3a0ca762fd16d033c5f589ad003c4a1338cecc1fe9340f9ad15b39: Status 404 returned error can't find the container with id cb84e3018e3a0ca762fd16d033c5f589ad003c4a1338cecc1fe9340f9ad15b39 Jun 14 20:31:37.142189 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.142133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" event={"ID":"41d39a62-8592-4ffa-a612-0137f0a24440","Type":"ContainerStarted","Data":"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0"} Jun 14 20:31:37.142189 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.142174 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" podUID="41d39a62-8592-4ffa-a612-0137f0a24440" containerName="authorino" containerID="cri-o://80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0" gracePeriod=30 Jun 14 20:31:37.142606 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.142196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" event={"ID":"41d39a62-8592-4ffa-a612-0137f0a24440","Type":"ContainerStarted","Data":"cb84e3018e3a0ca762fd16d033c5f589ad003c4a1338cecc1fe9340f9ad15b39"} Jun 14 20:31:37.157799 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.157753 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" podStartSLOduration=1.817526185 podStartE2EDuration="2.157737843s" totalImagesPullingTime="340.211658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:31:37.155635506 +0000 UTC m=+814.025414939" watchObservedRunningTime="2026-06-14 20:31:37.157737843 +0000 UTC m=+814.027517273" Jun 14 20:31:37.395314 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.395259 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:37.519271 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.519243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55dmh\" (UniqueName: \"kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh\") pod \"41d39a62-8592-4ffa-a612-0137f0a24440\" (UID: \"41d39a62-8592-4ffa-a612-0137f0a24440\") " Jun 14 20:31:37.521218 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.521191 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh" (OuterVolumeSpecName: "kube-api-access-55dmh") pod "41d39a62-8592-4ffa-a612-0137f0a24440" (UID: "41d39a62-8592-4ffa-a612-0137f0a24440"). InnerVolumeSpecName "kube-api-access-55dmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:31:37.620409 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:37.620380 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55dmh\" (UniqueName: \"kubernetes.io/projected/41d39a62-8592-4ffa-a612-0137f0a24440-kube-api-access-55dmh\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:31:38.149090 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.149046 2576 generic.go:356] "Generic (PLEG): container finished" podID="41d39a62-8592-4ffa-a612-0137f0a24440" containerID="80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0" exitCode=0 Jun 14 20:31:38.149526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.149097 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" Jun 14 20:31:38.149526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.149099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" event={"ID":"41d39a62-8592-4ffa-a612-0137f0a24440","Type":"ContainerDied","Data":"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0"} Jun 14 20:31:38.149526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.149193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z9lcs" event={"ID":"41d39a62-8592-4ffa-a612-0137f0a24440","Type":"ContainerDied","Data":"cb84e3018e3a0ca762fd16d033c5f589ad003c4a1338cecc1fe9340f9ad15b39"} Jun 14 20:31:38.149526 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.149209 2576 scope.go:117] "RemoveContainer" containerID="80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0" Jun 14 20:31:38.158456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.158439 2576 scope.go:117] "RemoveContainer" containerID="80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0" Jun 14 20:31:38.158748 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:31:38.158721 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0\": container with ID starting with 80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0 not found: ID does not exist" containerID="80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0" Jun 14 20:31:38.158796 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.158758 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0"} err="failed to get container status \"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0\": rpc error: code = NotFound desc = could not find container \"80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0\": container with ID starting with 80e1f6590f178720ca252226c006345118a045ec1fffe018cbe2c5e5b7e131b0 not found: ID does not exist" Jun 14 20:31:38.171001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.170981 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:38.174767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:38.174747 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z9lcs"] Jun 14 20:31:39.499225 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:39.499194 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d39a62-8592-4ffa-a612-0137f0a24440" path="/var/lib/kubelet/pods/41d39a62-8592-4ffa-a612-0137f0a24440/volumes" Jun 14 20:31:41.092006 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.091970 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:41.106804 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.106775 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:41.107195 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.107181 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d39a62-8592-4ffa-a612-0137f0a24440" containerName="authorino" Jun 14 20:31:41.107245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.107197 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d39a62-8592-4ffa-a612-0137f0a24440" containerName="authorino" Jun 14 20:31:41.107279 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.107256 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41d39a62-8592-4ffa-a612-0137f0a24440" containerName="authorino" Jun 14 20:31:41.110542 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.110527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.112942 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.112921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 20:31:41.112942 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.112943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sszfd\"" Jun 14 20:31:41.113873 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.113860 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 20:31:41.119447 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.119421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:41.151495 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.151469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.151622 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.151518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsjv4\" (UniqueName: \"kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.192072 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.192046 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:41.249371 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.249343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:41.252379 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.252360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.252444 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.252406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsjv4\" (UniqueName: \"kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.252523 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:31:41.252495 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 20:31:41.252648 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:31:41.252568 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert podName:25c8c557-121a-4c4f-bfda-80558fe82f0b nodeName:}" failed. No retries permitted until 2026-06-14 20:31:41.752552487 +0000 UTC m=+818.622331896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert") pod "maas-controller-f649d79fb-2xrt4" (UID: "25c8c557-121a-4c4f-bfda-80558fe82f0b") : secret "maas-controller-webhook-cert" not found Jun 14 20:31:41.261071 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.261046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsjv4\" (UniqueName: \"kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.273462 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.273439 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b7449957-5frfx"] Jun 14 20:31:41.276072 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.276058 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.284671 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.284652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b7449957-5frfx"] Jun 14 20:31:41.336487 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.336456 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:41.353582 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.353525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2xc\" (UniqueName: \"kubernetes.io/projected/f5441195-c0bc-449a-a259-1cfcdf5c2956-kube-api-access-rg2xc\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.353670 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.353599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5441195-c0bc-449a-a259-1cfcdf5c2956-webhook-cert\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.454939 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.454914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5441195-c0bc-449a-a259-1cfcdf5c2956-webhook-cert\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.455068 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.454963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2xc\" (UniqueName: \"kubernetes.io/projected/f5441195-c0bc-449a-a259-1cfcdf5c2956-kube-api-access-rg2xc\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.457428 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.457399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f5441195-c0bc-449a-a259-1cfcdf5c2956-webhook-cert\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.462624 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.462601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2xc\" (UniqueName: \"kubernetes.io/projected/f5441195-c0bc-449a-a259-1cfcdf5c2956-kube-api-access-rg2xc\") pod \"maas-controller-8b7449957-5frfx\" (UID: \"f5441195-c0bc-449a-a259-1cfcdf5c2956\") " pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.587296 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.587265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:41.717297 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.717271 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b7449957-5frfx"] Jun 14 20:31:41.718541 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:31:41.718519 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5441195_c0bc_449a_a259_1cfcdf5c2956.slice/crio-9bf0bc640a40b385c10bca6b9137af275d24bb8cc68b9f281ca15f8b001b8a11 WatchSource:0}: Error finding container 9bf0bc640a40b385c10bca6b9137af275d24bb8cc68b9f281ca15f8b001b8a11: Status 404 returned error can't find the container with id 9bf0bc640a40b385c10bca6b9137af275d24bb8cc68b9f281ca15f8b001b8a11 Jun 14 20:31:41.758585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.758557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:41.760747 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:41.760730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") pod \"maas-controller-f649d79fb-2xrt4\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:42.022490 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:42.022396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:42.153344 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:42.153321 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:42.154376 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:31:42.154355 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c8c557_121a_4c4f_bfda_80558fe82f0b.slice/crio-0165dd342fb595313ab9a514688329d6d3adb5b3707d63bcc424e72386a43920 WatchSource:0}: Error finding container 0165dd342fb595313ab9a514688329d6d3adb5b3707d63bcc424e72386a43920: Status 404 returned error can't find the container with id 0165dd342fb595313ab9a514688329d6d3adb5b3707d63bcc424e72386a43920 Jun 14 20:31:42.175187 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:42.175158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f649d79fb-2xrt4" event={"ID":"25c8c557-121a-4c4f-bfda-80558fe82f0b","Type":"ContainerStarted","Data":"0165dd342fb595313ab9a514688329d6d3adb5b3707d63bcc424e72386a43920"} Jun 14 20:31:42.176428 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:42.176398 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b7449957-5frfx" event={"ID":"f5441195-c0bc-449a-a259-1cfcdf5c2956","Type":"ContainerStarted","Data":"9bf0bc640a40b385c10bca6b9137af275d24bb8cc68b9f281ca15f8b001b8a11"} Jun 14 20:31:44.524078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:44.524048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:44.618810 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:44.618725 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:45.205929 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.205891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f649d79fb-2xrt4" event={"ID":"25c8c557-121a-4c4f-bfda-80558fe82f0b","Type":"ContainerStarted","Data":"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b"} Jun 14 20:31:45.206107 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.205995 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:45.207340 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.207316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b7449957-5frfx" event={"ID":"f5441195-c0bc-449a-a259-1cfcdf5c2956","Type":"ContainerStarted","Data":"4e6bcaad8432d66fe41a65bd82e6cd9c075a6f49b53cdab73423c0fdbfc070df"} Jun 14 20:31:45.207467 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.207449 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:45.224425 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.224379 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f649d79fb-2xrt4" podStartSLOduration=2.049458476 podStartE2EDuration="4.224366655s" totalImagesPullingTime="2.174908179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:31:45.221532415 +0000 UTC m=+822.091311858" watchObservedRunningTime="2026-06-14 20:31:45.224366655 +0000 UTC m=+822.094146086" Jun 14 20:31:45.239661 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:45.239612 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8b7449957-5frfx" podStartSLOduration=1.622349518 podStartE2EDuration="4.239600705s" totalImagesPullingTime="2.617251187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:31:45.238065349 +0000 UTC m=+822.107844806" watchObservedRunningTime="2026-06-14 20:31:45.239600705 +0000 UTC m=+822.109380135" Jun 14 20:31:49.323332 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:49.323282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:31:56.218660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.218629 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b7449957-5frfx" Jun 14 20:31:56.219056 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.218697 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:56.279909 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.279870 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:56.280112 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.280088 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f649d79fb-2xrt4" podUID="25c8c557-121a-4c4f-bfda-80558fe82f0b" containerName="manager" containerID="cri-o://25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b" gracePeriod=30 Jun 14 20:31:56.523749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.523727 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:56.687205 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.687141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsjv4\" (UniqueName: \"kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4\") pod \"25c8c557-121a-4c4f-bfda-80558fe82f0b\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " Jun 14 20:31:56.687384 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.687226 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") pod \"25c8c557-121a-4c4f-bfda-80558fe82f0b\" (UID: \"25c8c557-121a-4c4f-bfda-80558fe82f0b\") " Jun 14 20:31:56.689306 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.689271 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4" (OuterVolumeSpecName: "kube-api-access-qsjv4") pod "25c8c557-121a-4c4f-bfda-80558fe82f0b" (UID: "25c8c557-121a-4c4f-bfda-80558fe82f0b"). InnerVolumeSpecName "kube-api-access-qsjv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:31:56.689306 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.689288 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "25c8c557-121a-4c4f-bfda-80558fe82f0b" (UID: "25c8c557-121a-4c4f-bfda-80558fe82f0b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:31:56.788235 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.788135 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsjv4\" (UniqueName: \"kubernetes.io/projected/25c8c557-121a-4c4f-bfda-80558fe82f0b-kube-api-access-qsjv4\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:31:56.788235 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:56.788186 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c8c557-121a-4c4f-bfda-80558fe82f0b-webhook-cert\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:31:57.280288 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.280247 2576 generic.go:356] "Generic (PLEG): container finished" podID="25c8c557-121a-4c4f-bfda-80558fe82f0b" containerID="25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b" exitCode=0 Jun 14 20:31:57.280660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.280312 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f649d79fb-2xrt4" Jun 14 20:31:57.280660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.280338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f649d79fb-2xrt4" event={"ID":"25c8c557-121a-4c4f-bfda-80558fe82f0b","Type":"ContainerDied","Data":"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b"} Jun 14 20:31:57.280660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.280396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f649d79fb-2xrt4" event={"ID":"25c8c557-121a-4c4f-bfda-80558fe82f0b","Type":"ContainerDied","Data":"0165dd342fb595313ab9a514688329d6d3adb5b3707d63bcc424e72386a43920"} Jun 14 20:31:57.280660 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.280421 2576 scope.go:117] "RemoveContainer" containerID="25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b" Jun 14 20:31:57.290025 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.290007 2576 scope.go:117] "RemoveContainer" containerID="25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b" Jun 14 20:31:57.290297 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:31:57.290278 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b\": container with ID starting with 25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b not found: ID does not exist" containerID="25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b" Jun 14 20:31:57.290358 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.290304 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b"} err="failed to get container status \"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b\": rpc error: code = NotFound desc = could not find container \"25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b\": container with ID starting with 25ad7ee62bae43a65e9dc62c7efe4897b173c62a9c0ebe2b2e5a986f0aa9296b not found: ID does not exist" Jun 14 20:31:57.302478 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.302449 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:57.306883 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.306861 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f649d79fb-2xrt4"] Jun 14 20:31:57.499523 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:31:57.499488 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25c8c557-121a-4c4f-bfda-80558fe82f0b" path="/var/lib/kubelet/pods/25c8c557-121a-4c4f-bfda-80558fe82f0b/volumes" Jun 14 20:32:17.754198 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:17.754119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:17.902614 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:17.902582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:18.158667 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.158636 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:18.264730 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.264699 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s89wg"] Jun 14 20:32:18.265348 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.265322 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25c8c557-121a-4c4f-bfda-80558fe82f0b" containerName="manager" Jun 14 20:32:18.265529 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.265507 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="25c8c557-121a-4c4f-bfda-80558fe82f0b" containerName="manager" Jun 14 20:32:18.265673 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.265660 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="25c8c557-121a-4c4f-bfda-80558fe82f0b" containerName="manager" Jun 14 20:32:18.266109 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.266087 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:18.273598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.273579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:18.276202 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.276176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bp4sx\"" Jun 14 20:32:18.276305 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.276270 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 20:32:18.277209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.277184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s89wg"] Jun 14 20:32:18.302870 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.302849 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-nw79l"] Jun 14 20:32:18.306824 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.306810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:18.315957 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.315935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-nw79l"] Jun 14 20:32:18.366514 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.366485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqvk\" (UniqueName: \"kubernetes.io/projected/a6c8e039-d630-4faf-83ec-d62d4766fe18-kube-api-access-2cqvk\") pod \"payload-pre-processing-579785bc64-s89wg\" (UID: \"a6c8e039-d630-4faf-83ec-d62d4766fe18\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:18.366651 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.366517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5txx\" (UniqueName: \"kubernetes.io/projected/eaa6e598-abd6-4c1c-86a0-5d3e130552b5-kube-api-access-g5txx\") pod \"payload-processing-699b6cd6c-nw79l\" (UID: \"eaa6e598-abd6-4c1c-86a0-5d3e130552b5\") " pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:18.467108 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.467030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqvk\" (UniqueName: \"kubernetes.io/projected/a6c8e039-d630-4faf-83ec-d62d4766fe18-kube-api-access-2cqvk\") pod \"payload-pre-processing-579785bc64-s89wg\" (UID: \"a6c8e039-d630-4faf-83ec-d62d4766fe18\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:18.467108 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.467063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5txx\" (UniqueName: \"kubernetes.io/projected/eaa6e598-abd6-4c1c-86a0-5d3e130552b5-kube-api-access-g5txx\") pod \"payload-processing-699b6cd6c-nw79l\" (UID: \"eaa6e598-abd6-4c1c-86a0-5d3e130552b5\") " pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:18.474855 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.474821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5txx\" (UniqueName: \"kubernetes.io/projected/eaa6e598-abd6-4c1c-86a0-5d3e130552b5-kube-api-access-g5txx\") pod \"payload-processing-699b6cd6c-nw79l\" (UID: \"eaa6e598-abd6-4c1c-86a0-5d3e130552b5\") " pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:18.474969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.474922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqvk\" (UniqueName: \"kubernetes.io/projected/a6c8e039-d630-4faf-83ec-d62d4766fe18-kube-api-access-2cqvk\") pod \"payload-pre-processing-579785bc64-s89wg\" (UID: \"a6c8e039-d630-4faf-83ec-d62d4766fe18\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:18.585789 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.585763 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:18.618006 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.617977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:18.731787 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.731744 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s89wg"] Jun 14 20:32:18.732276 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:32:18.732253 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c8e039_d630_4faf_83ec_d62d4766fe18.slice/crio-52ec233d28050626ddef896e2b260713d82560a4b46f062b6a61d68a0bc078ed WatchSource:0}: Error finding container 52ec233d28050626ddef896e2b260713d82560a4b46f062b6a61d68a0bc078ed: Status 404 returned error can't find the container with id 52ec233d28050626ddef896e2b260713d82560a4b46f062b6a61d68a0bc078ed Jun 14 20:32:18.762135 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:18.762109 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-nw79l"] Jun 14 20:32:18.763690 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:32:18.763661 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa6e598_abd6_4c1c_86a0_5d3e130552b5.slice/crio-571f78386f4b37cbfc03817a8b0e24057959de5bcdeb62ba7850a43363859920 WatchSource:0}: Error finding container 571f78386f4b37cbfc03817a8b0e24057959de5bcdeb62ba7850a43363859920: Status 404 returned error can't find the container with id 571f78386f4b37cbfc03817a8b0e24057959de5bcdeb62ba7850a43363859920 Jun 14 20:32:19.416459 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:19.416413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" event={"ID":"eaa6e598-abd6-4c1c-86a0-5d3e130552b5","Type":"ContainerStarted","Data":"571f78386f4b37cbfc03817a8b0e24057959de5bcdeb62ba7850a43363859920"} Jun 14 20:32:19.418508 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:19.418435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" event={"ID":"a6c8e039-d630-4faf-83ec-d62d4766fe18","Type":"ContainerStarted","Data":"52ec233d28050626ddef896e2b260713d82560a4b46f062b6a61d68a0bc078ed"} Jun 14 20:32:19.968553 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:19.968510 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:20.015651 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:20.015621 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:32:21.430743 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.430646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" event={"ID":"a6c8e039-d630-4faf-83ec-d62d4766fe18","Type":"ContainerStarted","Data":"676d7acce71c072fa7f1de9356bba49e3400df3fa0d9a3bf0a5aac9497d4ad9a"} Jun 14 20:32:21.430743 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.430728 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:21.432402 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.432373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" event={"ID":"eaa6e598-abd6-4c1c-86a0-5d3e130552b5","Type":"ContainerStarted","Data":"424648bc6f5a1d401e185e5981672047131945e1c9f59de255a768400f85d936"} Jun 14 20:32:21.432553 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.432427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:21.450446 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.450384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" podStartSLOduration=1.021540391 podStartE2EDuration="3.450366516s" totalImagesPullingTime="2.428826125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:32:21.445726351 +0000 UTC m=+858.315505807" watchObservedRunningTime="2026-06-14 20:32:21.450366516 +0000 UTC m=+858.320145948" Jun 14 20:32:21.461735 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:21.461681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" podStartSLOduration=1.057465894 podStartE2EDuration="3.461664312s" totalImagesPullingTime="2.404198418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:32:21.460707282 +0000 UTC m=+858.330486717" watchObservedRunningTime="2026-06-14 20:32:21.461664312 +0000 UTC m=+858.331443745" Jun 14 20:32:28.324802 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:28.324766 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:28.325209 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:28.324955 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" containerID="cri-o://9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0" gracePeriod=30 Jun 14 20:32:30.360553 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.360530 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.461469 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.461439 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf4wg\" (UniqueName: \"kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg\") pod \"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da\" (UID: \"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da\") " Jun 14 20:32:30.463575 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.463548 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg" (OuterVolumeSpecName: "kube-api-access-cf4wg") pod "a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" (UID: "a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da"). InnerVolumeSpecName "kube-api-access-cf4wg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:32:30.481678 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.481649 2576 generic.go:356] "Generic (PLEG): container finished" podID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerID="9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0" exitCode=143 Jun 14 20:32:30.481791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.481696 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.481791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.481731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da","Type":"ContainerDied","Data":"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0"} Jun 14 20:32:30.481791 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.481781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da","Type":"ContainerDied","Data":"e85cfa43793bbe4a32f6869a5c495586c5f73f863325d57bd2902471a06ec1c0"} Jun 14 20:32:30.481892 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.481801 2576 scope.go:117] "RemoveContainer" containerID="9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0" Jun 14 20:32:30.491733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.491718 2576 scope.go:117] "RemoveContainer" containerID="9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0" Jun 14 20:32:30.491980 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:32:30.491964 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0\": container with ID starting with 9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0 not found: ID does not exist" containerID="9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0" Jun 14 20:32:30.492026 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.491990 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0"} err="failed to get container status \"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0\": rpc error: code = NotFound desc = could not find container \"9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0\": container with ID starting with 9d7f3ac9751f19085ff5a81ce3cd4138db1bec5d45c336fdceeb34e9c10e1ca0 not found: ID does not exist" Jun 14 20:32:30.502969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.502948 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:30.505298 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.505265 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:30.523591 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.523568 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:30.523948 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.523935 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" Jun 14 20:32:30.524023 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.523951 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" Jun 14 20:32:30.524023 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.524013 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" containerName="keycloak" Jun 14 20:32:30.528023 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.528008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.530438 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.530418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 20:32:30.530543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.530452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-xjpxd\"" Jun 14 20:32:30.530543 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.530466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 20:32:30.530644 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.530629 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 14 20:32:30.530688 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.530645 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 20:32:30.535080 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.535059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:30.562005 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.561981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/31e375ba-003a-4efe-b5c8-4c9b92389316-test-realms\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.562138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.562039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8kmk\" (UniqueName: \"kubernetes.io/projected/31e375ba-003a-4efe-b5c8-4c9b92389316-kube-api-access-j8kmk\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.562138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.562082 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf4wg\" (UniqueName: \"kubernetes.io/projected/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da-kube-api-access-cf4wg\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:32:30.662880 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.662854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/31e375ba-003a-4efe-b5c8-4c9b92389316-test-realms\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.662988 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.662921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8kmk\" (UniqueName: \"kubernetes.io/projected/31e375ba-003a-4efe-b5c8-4c9b92389316-kube-api-access-j8kmk\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.663562 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.663544 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/31e375ba-003a-4efe-b5c8-4c9b92389316-test-realms\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.670536 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.670517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8kmk\" (UniqueName: \"kubernetes.io/projected/31e375ba-003a-4efe-b5c8-4c9b92389316-kube-api-access-j8kmk\") pod \"maas-keycloak-0\" (UID: \"31e375ba-003a-4efe-b5c8-4c9b92389316\") " pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.838785 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.838745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:30.995694 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:30.995665 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 20:32:30.997343 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:32:30.997320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e375ba_003a_4efe_b5c8_4c9b92389316.slice/crio-94254072353d1e3c7bdf8459f95057fcbbca6d104e961b4d0f1d78679160b851 WatchSource:0}: Error finding container 94254072353d1e3c7bdf8459f95057fcbbca6d104e961b4d0f1d78679160b851: Status 404 returned error can't find the container with id 94254072353d1e3c7bdf8459f95057fcbbca6d104e961b4d0f1d78679160b851 Jun 14 20:32:31.490714 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.490675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"31e375ba-003a-4efe-b5c8-4c9b92389316","Type":"ContainerStarted","Data":"94aa4679150101e06e811610360e7cf130d3820605b3b9ad923366c6a8c41d58"} Jun 14 20:32:31.491203 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.490733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"31e375ba-003a-4efe-b5c8-4c9b92389316","Type":"ContainerStarted","Data":"94254072353d1e3c7bdf8459f95057fcbbca6d104e961b4d0f1d78679160b851"} Jun 14 20:32:31.502031 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.501997 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da" path="/var/lib/kubelet/pods/a42cbc4c-efcb-49d1-90ad-72bd8f8ba6da/volumes" Jun 14 20:32:31.509755 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.509508 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.195223424 podStartE2EDuration="1.509491811s" totalImagesPullingTime="314.268387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:32:31.50871766 +0000 UTC m=+868.378497092" watchObservedRunningTime="2026-06-14 20:32:31.509491811 +0000 UTC m=+868.379271243" Jun 14 20:32:31.839250 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.839211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:31.840688 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:31.840656 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:32.440215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:32.440179 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-nw79l" Jun 14 20:32:32.440510 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:32.440491 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s89wg" Jun 14 20:32:32.839857 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:32.839805 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:33.839919 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:33.839864 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:34.839845 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:34.839794 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:35.839489 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:35.839431 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:36.839518 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:36.839457 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:37.849438 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:37.849379 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:38.840022 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:38.839973 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:39.839620 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:39.839569 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:40.839793 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:40.839760 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:40.840223 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:40.840180 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:41.839501 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:41.839455 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:42.840044 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:42.839996 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:43.839511 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:43.839454 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 14 20:32:44.965378 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:44.965335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 20:32:44.984760 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:44.984715 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="31e375ba-003a-4efe-b5c8-4c9b92389316" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 20:32:54.971255 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:32:54.971164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 20:33:03.546710 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:03.546673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:33:03.550425 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:03.550403 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:33:05.713250 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.713209 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:33:05.715654 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.715640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.718132 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.718113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nmmzl\"" Jun 14 20:33:05.719118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.719105 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 20:33:05.719197 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.719169 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 20:33:05.724072 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.724052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:33:05.894850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.894815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.894850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.894848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.895073 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.894877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc9mp\" (UniqueName: \"kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.995790 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.995719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.995790 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.995751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.995790 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.995776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc9mp\" (UniqueName: \"kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.996418 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.996388 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:05.998231 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:05.998210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:06.003106 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.003084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc9mp\" (UniqueName: \"kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp\") pod \"authorino-564dfbb468-slpsv\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:06.026018 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.025998 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:33:06.163677 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.163651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:33:06.165916 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:33:06.165887 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf40bad27_bc3a_44e8_9655_6c03efb5bdea.slice/crio-1682701be23839ee6763af861b3f1ed7a8e61d5bafd2c1b812033bc39b49b22f WatchSource:0}: Error finding container 1682701be23839ee6763af861b3f1ed7a8e61d5bafd2c1b812033bc39b49b22f: Status 404 returned error can't find the container with id 1682701be23839ee6763af861b3f1ed7a8e61d5bafd2c1b812033bc39b49b22f Jun 14 20:33:06.739433 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.739399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564dfbb468-slpsv" event={"ID":"f40bad27-bc3a-44e8-9655-6c03efb5bdea","Type":"ContainerStarted","Data":"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0"} Jun 14 20:33:06.739872 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.739442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564dfbb468-slpsv" event={"ID":"f40bad27-bc3a-44e8-9655-6c03efb5bdea","Type":"ContainerStarted","Data":"1682701be23839ee6763af861b3f1ed7a8e61d5bafd2c1b812033bc39b49b22f"} Jun 14 20:33:06.756067 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:06.756016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-564dfbb468-slpsv" podStartSLOduration=1.4145045330000001 podStartE2EDuration="1.756002163s" totalImagesPullingTime="341.49763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:33:06.754181933 +0000 UTC m=+903.623961363" watchObservedRunningTime="2026-06-14 20:33:06.756002163 +0000 UTC m=+903.625781601" Jun 14 20:33:07.394990 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:07.394956 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:07.494479 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:07.494431 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:18.138630 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:18.138600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:23.408875 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.408836 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm"] Jun 14 20:33:23.411638 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.411623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.415111 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.415089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5jsvk\"" Jun 14 20:33:23.415111 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.415105 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 20:33:23.415318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.415089 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 20:33:23.415318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.415089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 20:33:23.424430 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.424405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm"] Jun 14 20:33:23.439711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.439814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.439814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj972\" (UniqueName: \"kubernetes.io/projected/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kube-api-access-cj972\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.439814 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.439928 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.439928 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.439902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.501500 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.501476 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:23.540866 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.540992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.540992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj972\" (UniqueName: \"kubernetes.io/projected/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kube-api-access-cj972\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.540992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.540992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.540992 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.540984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.541330 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.541307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.541386 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.541329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.541386 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.541361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.543173 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.543134 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.543365 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.543349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.549319 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.549295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj972\" (UniqueName: \"kubernetes.io/projected/4de6a153-e2de-42e2-9e40-b4144bc4c1c9-kube-api-access-cj972\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-vgwdm\" (UID: \"4de6a153-e2de-42e2-9e40-b4144bc4c1c9\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.724462 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.724384 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:23.860458 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:23.860429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm"] Jun 14 20:33:23.862039 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:33:23.862016 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de6a153_e2de_42e2_9e40_b4144bc4c1c9.slice/crio-1f310a9792b682d928fb1114eed6857713a9e0dd17937b428044d925ddc72fab WatchSource:0}: Error finding container 1f310a9792b682d928fb1114eed6857713a9e0dd17937b428044d925ddc72fab: Status 404 returned error can't find the container with id 1f310a9792b682d928fb1114eed6857713a9e0dd17937b428044d925ddc72fab Jun 14 20:33:24.851970 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:24.851927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" event={"ID":"4de6a153-e2de-42e2-9e40-b4144bc4c1c9","Type":"ContainerStarted","Data":"1f310a9792b682d928fb1114eed6857713a9e0dd17937b428044d925ddc72fab"} Jun 14 20:33:26.867349 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:26.867260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" event={"ID":"4de6a153-e2de-42e2-9e40-b4144bc4c1c9","Type":"ContainerStarted","Data":"82be6029ea64d428467e44365efe8bd3b75b75013ec573259ddcec5717c3f8fa"} Jun 14 20:33:27.435004 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:27.434960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:28.879981 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:28.879945 2576 generic.go:356] "Generic (PLEG): container finished" podID="4de6a153-e2de-42e2-9e40-b4144bc4c1c9" containerID="82be6029ea64d428467e44365efe8bd3b75b75013ec573259ddcec5717c3f8fa" exitCode=0 Jun 14 20:33:28.880496 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:28.880021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" event={"ID":"4de6a153-e2de-42e2-9e40-b4144bc4c1c9","Type":"ContainerDied","Data":"82be6029ea64d428467e44365efe8bd3b75b75013ec573259ddcec5717c3f8fa"} Jun 14 20:33:30.892769 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:30.892733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" event={"ID":"4de6a153-e2de-42e2-9e40-b4144bc4c1c9","Type":"ContainerStarted","Data":"172982695c24c660ec6069fc47f1ad6ede693d2ec8cd8a044f93ee3d8e91c8de"} Jun 14 20:33:30.912528 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:30.912478 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" podStartSLOduration=2.9214226439999997 podStartE2EDuration="7.912461924s" totalImagesPullingTime="3.722155848s" totalInitContainerRuntime="1.268883432s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:33:30.909183899 +0000 UTC m=+927.778963342" watchObservedRunningTime="2026-06-14 20:33:30.912461924 +0000 UTC m=+927.782241355" Jun 14 20:33:33.724607 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:33.724580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:33.725037 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:33.724650 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:33.739767 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:33.739733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:33.920100 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:33.920073 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-vgwdm" Jun 14 20:33:37.237339 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:37.237307 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:50.219062 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.219029 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82"] Jun 14 20:33:50.292320 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.292291 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:50.379808 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.379779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82"] Jun 14 20:33:50.379944 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.379893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.382281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.382260 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 14 20:33:50.476899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.476832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26594cb8-7369-4820-ae5a-5ee9c2de376e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.476899 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.476879 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.477057 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.476918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.477057 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.476954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.477057 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.477017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.477057 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.477041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxpd5\" (UniqueName: \"kubernetes.io/projected/26594cb8-7369-4820-ae5a-5ee9c2de376e-kube-api-access-vxpd5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.577808 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.577780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.577912 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.577826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.577912 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.577852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxpd5\" (UniqueName: \"kubernetes.io/projected/26594cb8-7369-4820-ae5a-5ee9c2de376e-kube-api-access-vxpd5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.577912 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.577896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26594cb8-7369-4820-ae5a-5ee9c2de376e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.578045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.577952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.578045 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.578026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.578306 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.578282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.578389 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.578318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.578491 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.578473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.580228 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.580202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26594cb8-7369-4820-ae5a-5ee9c2de376e-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.580456 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.580433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26594cb8-7369-4820-ae5a-5ee9c2de376e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.585103 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.585081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxpd5\" (UniqueName: \"kubernetes.io/projected/26594cb8-7369-4820-ae5a-5ee9c2de376e-kube-api-access-vxpd5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-bxd82\" (UID: \"26594cb8-7369-4820-ae5a-5ee9c2de376e\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.690440 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.690410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:33:50.846061 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:50.846031 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82"] Jun 14 20:33:50.846357 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:33:50.846329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26594cb8_7369_4820_ae5a_5ee9c2de376e.slice/crio-c8b0e40a6051399a425148225911f8e10c566ae2aebb6246fd41523dd7303ea8 WatchSource:0}: Error finding container c8b0e40a6051399a425148225911f8e10c566ae2aebb6246fd41523dd7303ea8: Status 404 returned error can't find the container with id c8b0e40a6051399a425148225911f8e10c566ae2aebb6246fd41523dd7303ea8 Jun 14 20:33:51.004442 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:51.004361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" event={"ID":"26594cb8-7369-4820-ae5a-5ee9c2de376e","Type":"ContainerStarted","Data":"e5fa485f6a30e3f39cdbf5a8877228b70614e59dc1af1c082c0dca0c27ae466f"} Jun 14 20:33:51.004442 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:51.004421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" event={"ID":"26594cb8-7369-4820-ae5a-5ee9c2de376e","Type":"ContainerStarted","Data":"c8b0e40a6051399a425148225911f8e10c566ae2aebb6246fd41523dd7303ea8"} Jun 14 20:33:53.016270 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:53.016234 2576 generic.go:356] "Generic (PLEG): container finished" podID="26594cb8-7369-4820-ae5a-5ee9c2de376e" containerID="e5fa485f6a30e3f39cdbf5a8877228b70614e59dc1af1c082c0dca0c27ae466f" exitCode=0 Jun 14 20:33:53.016727 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:53.016317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" event={"ID":"26594cb8-7369-4820-ae5a-5ee9c2de376e","Type":"ContainerDied","Data":"e5fa485f6a30e3f39cdbf5a8877228b70614e59dc1af1c082c0dca0c27ae466f"} Jun 14 20:33:53.742766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:53.742733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:33:54.023467 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:54.023384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" event={"ID":"26594cb8-7369-4820-ae5a-5ee9c2de376e","Type":"ContainerStarted","Data":"3152a2ee810638fe70f1e617499c0fdb83354ee00e4d8048663f49ee39487ade"} Jun 14 20:33:54.042555 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:33:54.042506 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" podStartSLOduration=2.651727617 podStartE2EDuration="4.042492601s" totalImagesPullingTime="153.961751ms" totalInitContainerRuntime="1.236803233s" isStatefulPod=false podCreationTimestamp="2026-06-14 20:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:33:54.041015441 +0000 UTC m=+950.910794872" watchObservedRunningTime="2026-06-14 20:33:54.042492601 +0000 UTC m=+950.912272031" Jun 14 20:34:00.690548 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:34:00.690514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:34:00.691062 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:34:00.690567 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:34:00.703371 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:34:00.703346 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:34:01.074761 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:34:01.074733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-bxd82" Jun 14 20:35:07.595327 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.595286 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:35:07.595840 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.595526 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-564dfbb468-slpsv" podUID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" containerName="authorino" containerID="cri-o://59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0" gracePeriod=30 Jun 14 20:35:07.848969 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.848910 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:35:07.944659 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.944624 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert\") pod \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " Jun 14 20:35:07.944837 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.944694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc9mp\" (UniqueName: \"kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp\") pod \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " Jun 14 20:35:07.944837 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.944822 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca\") pod \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\" (UID: \"f40bad27-bc3a-44e8-9655-6c03efb5bdea\") " Jun 14 20:35:07.946641 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.946613 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp" (OuterVolumeSpecName: "kube-api-access-pc9mp") pod "f40bad27-bc3a-44e8-9655-6c03efb5bdea" (UID: "f40bad27-bc3a-44e8-9655-6c03efb5bdea"). InnerVolumeSpecName "kube-api-access-pc9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 20:35:07.949846 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.949820 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "f40bad27-bc3a-44e8-9655-6c03efb5bdea" (UID: "f40bad27-bc3a-44e8-9655-6c03efb5bdea"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 20:35:07.954959 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:07.954935 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f40bad27-bc3a-44e8-9655-6c03efb5bdea" (UID: "f40bad27-bc3a-44e8-9655-6c03efb5bdea"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 20:35:08.046251 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.046206 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc9mp\" (UniqueName: \"kubernetes.io/projected/f40bad27-bc3a-44e8-9655-6c03efb5bdea-kube-api-access-pc9mp\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:35:08.046251 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.046244 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f40bad27-bc3a-44e8-9655-6c03efb5bdea-oidc-ca\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:35:08.046251 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.046256 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f40bad27-bc3a-44e8-9655-6c03efb5bdea-tls-cert\") on node \"ip-10-0-129-240.ec2.internal\" DevicePath \"\"" Jun 14 20:35:08.207075 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.206993 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:35:08.310410 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.310374 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:35:08.467443 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.467364 2576 generic.go:356] "Generic (PLEG): container finished" podID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" containerID="59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0" exitCode=0 Jun 14 20:35:08.467443 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.467403 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564dfbb468-slpsv" Jun 14 20:35:08.467443 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.467421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564dfbb468-slpsv" event={"ID":"f40bad27-bc3a-44e8-9655-6c03efb5bdea","Type":"ContainerDied","Data":"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0"} Jun 14 20:35:08.467679 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.467461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564dfbb468-slpsv" event={"ID":"f40bad27-bc3a-44e8-9655-6c03efb5bdea","Type":"ContainerDied","Data":"1682701be23839ee6763af861b3f1ed7a8e61d5bafd2c1b812033bc39b49b22f"} Jun 14 20:35:08.467679 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.467482 2576 scope.go:117] "RemoveContainer" containerID="59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0" Jun 14 20:35:08.477244 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.477228 2576 scope.go:117] "RemoveContainer" containerID="59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0" Jun 14 20:35:08.477505 ip-10-0-129-240 kubenswrapper[2576]: E0614 20:35:08.477486 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0\": container with ID starting with 59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0 not found: ID does not exist" containerID="59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0" Jun 14 20:35:08.477577 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.477514 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0"} err="failed to get container status \"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0\": rpc error: code = NotFound desc = could not find container \"59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0\": container with ID starting with 59a4759ea15436380c3f68912a6a694112f0846d73d2f3b8c594ed83cc54d3a0 not found: ID does not exist" Jun 14 20:35:08.492073 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.492047 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:35:08.500278 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:08.500259 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-564dfbb468-slpsv"] Jun 14 20:35:09.327465 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:09.327435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:35:09.426336 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:09.426309 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:35:09.500279 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:09.500250 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" path="/var/lib/kubelet/pods/f40bad27-bc3a-44e8-9655-6c03efb5bdea/volumes" Jun 14 20:35:21.394801 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:21.394768 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:35:51.719608 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:51.719534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8b7449957-5frfx_f5441195-c0bc-449a-a259-1cfcdf5c2956/manager/0.log" Jun 14 20:35:52.265949 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:52.265920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-t99j2_d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc/copy-manifests/0.log" Jun 14 20:35:52.271672 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:52.271648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-t99j2_d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc/manager/0.log" Jun 14 20:35:53.090229 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.090205 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/util/0.log" Jun 14 20:35:53.094961 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.094937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/pull/0.log" Jun 14 20:35:53.100837 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.100818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/extract/0.log" Jun 14 20:35:53.209188 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.209165 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/util/0.log" Jun 14 20:35:53.214334 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.214314 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/pull/0.log" Jun 14 20:35:53.219274 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.219247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/extract/0.log" Jun 14 20:35:53.321883 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.321861 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/util/0.log" Jun 14 20:35:53.327433 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.327415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/pull/0.log" Jun 14 20:35:53.332812 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.332796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/extract/0.log" Jun 14 20:35:53.440343 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.440288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/pull/0.log" Jun 14 20:35:53.445587 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.445571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/extract/0.log" Jun 14 20:35:53.450940 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.450914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/util/0.log" Jun 14 20:35:53.786595 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.786513 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpk5b_46c9eaff-e484-4ae7-9eca-38ea71bdd30a/manager/0.log" Jun 14 20:35:53.887265 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:53.887236 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5nrrc_61584d59-8922-425f-bf71-48fe8836db10/kuadrant-console-plugin/0.log" Jun 14 20:35:54.310589 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:54.310557 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4lg4s_a433958c-bfb0-4965-aff8-b1400a01683b/manager/0.log" Jun 14 20:35:54.849733 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:54.849705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-28mkb_0d7e95b0-e191-421e-9a35-f30d435cef15/kube-auth-proxy/0.log" Jun 14 20:35:55.161135 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:55.161041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s89wg_a6c8e039-d630-4faf-83ec-d62d4766fe18/payload-pre-processing/0.log" Jun 14 20:35:55.262197 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:55.262161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-nw79l_eaa6e598-abd6-4c1c-86a0-5d3e130552b5/payload-processing/0.log" Jun 14 20:35:55.786598 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:55.786561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vgwdm_4de6a153-e2de-42e2-9e40-b4144bc4c1c9/storage-initializer/0.log" Jun 14 20:35:55.792361 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:55.792331 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-vgwdm_4de6a153-e2de-42e2-9e40-b4144bc4c1c9/main/0.log" Jun 14 20:35:56.116220 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:56.116193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bxd82_26594cb8-7369-4820-ae5a-5ee9c2de376e/storage-initializer/0.log" Jun 14 20:35:56.122078 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:35:56.122050 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-bxd82_26594cb8-7369-4820-ae5a-5ee9c2de376e/main/0.log" Jun 14 20:36:00.104582 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:00.104554 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:36:00.204880 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:00.204838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" limit=1024 Jun 14 20:36:02.866341 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:02.866315 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z4l54_399af912-ad68-410a-a104-f4a21b9376d9/global-pull-secret-syncer/0.log" Jun 14 20:36:02.905535 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:02.905511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwdnx_5ea3ad83-f6c2-4bc9-8506-6163cfecf861/konnectivity-agent/0.log" Jun 14 20:36:02.964611 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:02.964585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-240.ec2.internal_908085b0180256939b383508bf56d1cc/haproxy/0.log" Jun 14 20:36:07.304656 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.304614 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/extract/0.log" Jun 14 20:36:07.326911 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.326883 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/util/0.log" Jun 14 20:36:07.350394 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.350361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pkl52_749e8308-a970-463a-9b84-558f1a696c2e/pull/0.log" Jun 14 20:36:07.385643 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.385620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/extract/0.log" Jun 14 20:36:07.405009 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.404989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/util/0.log" Jun 14 20:36:07.424636 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.424613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0s94mk_e4bd1734-3f9d-40a6-9639-b8edc5c03cdd/pull/0.log" Jun 14 20:36:07.459483 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.459463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/extract/0.log" Jun 14 20:36:07.483960 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.483938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/util/0.log" Jun 14 20:36:07.501128 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.501109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739bccx_86023695-364e-4aa9-a6c6-4b138cdd27d9/pull/0.log" Jun 14 20:36:07.543455 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.543434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/extract/0.log" Jun 14 20:36:07.559114 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.559056 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/util/0.log" Jun 14 20:36:07.578165 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.578124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fwm6b_5162cff9-8e37-4883-9614-b88f5e9f5202/pull/0.log" Jun 14 20:36:07.690079 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.690057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpk5b_46c9eaff-e484-4ae7-9eca-38ea71bdd30a/manager/0.log" Jun 14 20:36:07.711393 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.711376 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5nrrc_61584d59-8922-425f-bf71-48fe8836db10/kuadrant-console-plugin/0.log" Jun 14 20:36:07.827205 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:07.827122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4lg4s_a433958c-bfb0-4965-aff8-b1400a01683b/manager/0.log" Jun 14 20:36:09.581410 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.581382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/alertmanager/0.log" Jun 14 20:36:09.598131 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.598113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/config-reloader/0.log" Jun 14 20:36:09.621210 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.621190 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/kube-rbac-proxy-web/0.log" Jun 14 20:36:09.639907 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.639890 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/kube-rbac-proxy/0.log" Jun 14 20:36:09.657605 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.657587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/kube-rbac-proxy-metric/0.log" Jun 14 20:36:09.677451 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.677433 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/prom-label-proxy/0.log" Jun 14 20:36:09.694138 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.694121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7098a1ac-dd1c-47c5-9e73-17c3fe8e36c8/init-config-reloader/0.log" Jun 14 20:36:09.749096 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.749077 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8g97_9d88d093-1b03-407c-b799-0dd2e40411dc/kube-state-metrics/0.log" Jun 14 20:36:09.763607 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.763587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8g97_9d88d093-1b03-407c-b799-0dd2e40411dc/kube-rbac-proxy-main/0.log" Jun 14 20:36:09.778569 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.778534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8g97_9d88d093-1b03-407c-b799-0dd2e40411dc/kube-rbac-proxy-self/0.log" Jun 14 20:36:09.919316 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.919232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scpqj_879931c6-51e7-4a64-8b6e-971d7526c846/node-exporter/0.log" Jun 14 20:36:09.934105 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.934073 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scpqj_879931c6-51e7-4a64-8b6e-971d7526c846/kube-rbac-proxy/0.log" Jun 14 20:36:09.953485 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:09.953466 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-scpqj_879931c6-51e7-4a64-8b6e-971d7526c846/init-textfile/0.log" Jun 14 20:36:10.406099 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.406057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-gzlf4_ad864df5-fce2-44b0-a9cf-04ca95e81249/prometheus-operator-admission-webhook/0.log" Jun 14 20:36:10.431169 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.431124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85486ff567-hgxnf_4492d6bb-5e95-4b46-974a-881627ca35a3/telemeter-client/0.log" Jun 14 20:36:10.452732 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.452708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85486ff567-hgxnf_4492d6bb-5e95-4b46-974a-881627ca35a3/reload/0.log" Jun 14 20:36:10.467850 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.467827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85486ff567-hgxnf_4492d6bb-5e95-4b46-974a-881627ca35a3/kube-rbac-proxy/0.log" Jun 14 20:36:10.529400 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.529379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/thanos-query/0.log" Jun 14 20:36:10.551318 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.551301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/kube-rbac-proxy-web/0.log" Jun 14 20:36:10.566590 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.566571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/kube-rbac-proxy/0.log" Jun 14 20:36:10.581516 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.581497 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/prom-label-proxy/0.log" Jun 14 20:36:10.597154 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.597135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/kube-rbac-proxy-rules/0.log" Jun 14 20:36:10.611861 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:10.611841 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6495bbc746-4z8rm_79652633-5d09-4849-ad3f-dbec96e7ee96/kube-rbac-proxy-metrics/0.log" Jun 14 20:36:12.097467 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:12.097438 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-7hwhs_5a1e49d3-868c-4282-8c38-ce64b286244c/networking-console-plugin/0.log" Jun 14 20:36:13.600095 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.600060 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk"] Jun 14 20:36:13.600483 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.600469 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" containerName="authorino" Jun 14 20:36:13.600529 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.600484 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" containerName="authorino" Jun 14 20:36:13.600571 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.600561 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f40bad27-bc3a-44e8-9655-6c03efb5bdea" containerName="authorino" Jun 14 20:36:13.604403 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.604387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.606790 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.606752 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbsqn\"/\"kube-root-ca.crt\"" Jun 14 20:36:13.608034 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.607946 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xbsqn\"/\"default-dockercfg-csxq2\"" Jun 14 20:36:13.608205 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.607995 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbsqn\"/\"openshift-service-ca.crt\"" Jun 14 20:36:13.611712 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.611662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk"] Jun 14 20:36:13.694641 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.694619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-proc\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.694766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.694661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-podres\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.694766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.694688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8l7\" (UniqueName: \"kubernetes.io/projected/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-kube-api-access-7x8l7\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.694766 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.694740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-lib-modules\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.694919 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.694801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-sys\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795439 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-sys\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-proc\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-podres\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8l7\" (UniqueName: \"kubernetes.io/projected/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-kube-api-access-7x8l7\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-lib-modules\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795538 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-sys\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795585 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-proc\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795876 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-podres\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.795876 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.795654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-lib-modules\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.803711 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.803689 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8l7\" (UniqueName: \"kubernetes.io/projected/3a657f12-87d4-49e7-98e0-64c4dfa9ef69-kube-api-access-7x8l7\") pod \"perf-node-gather-daemonset-ptgnk\" (UID: \"3a657f12-87d4-49e7-98e0-64c4dfa9ef69\") " pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:13.914927 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:13.914848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:14.047966 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:14.047934 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk"] Jun 14 20:36:14.049406 ip-10-0-129-240 kubenswrapper[2576]: W0614 20:36:14.049383 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a657f12_87d4_49e7_98e0_64c4dfa9ef69.slice/crio-b2db3a1fcc9d69f88dbcaf5cb2d6fd858c09a8163db630524bfb44f0a69d0794 WatchSource:0}: Error finding container b2db3a1fcc9d69f88dbcaf5cb2d6fd858c09a8163db630524bfb44f0a69d0794: Status 404 returned error can't find the container with id b2db3a1fcc9d69f88dbcaf5cb2d6fd858c09a8163db630524bfb44f0a69d0794 Jun 14 20:36:14.853875 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:14.853841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" event={"ID":"3a657f12-87d4-49e7-98e0-64c4dfa9ef69","Type":"ContainerStarted","Data":"cce3612309b776be09fa69afc5d18c432b70ce8c3eefe8130d80e271ccd91fb9"} Jun 14 20:36:14.854273 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:14.853896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" event={"ID":"3a657f12-87d4-49e7-98e0-64c4dfa9ef69","Type":"ContainerStarted","Data":"b2db3a1fcc9d69f88dbcaf5cb2d6fd858c09a8163db630524bfb44f0a69d0794"} Jun 14 20:36:14.854273 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:14.853923 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:14.869484 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:14.869436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" podStartSLOduration=1.869423101 podStartE2EDuration="1.869423101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 20:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 20:36:14.868731143 +0000 UTC m=+1091.738510631" watchObservedRunningTime="2026-06-14 20:36:14.869423101 +0000 UTC m=+1091.739202554" Jun 14 20:36:15.159380 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:15.159310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ms2v6_2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5/dns/0.log" Jun 14 20:36:15.174453 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:15.174428 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ms2v6_2f2b5dc8-04a9-4fb3-8a9c-2af6c8f3abd5/kube-rbac-proxy/0.log" Jun 14 20:36:15.279025 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:15.278999 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jrk6k_8b05a51a-4f76-43dd-9d3d-13ada924c188/dns-node-resolver/0.log" Jun 14 20:36:15.838118 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:15.838090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbwmz_777aa617-d758-4411-842e-4f8af4c0e336/node-ca/0.log" Jun 14 20:36:16.766619 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:16.766587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-28mkb_0d7e95b0-e191-421e-9a35-f30d435cef15/kube-auth-proxy/0.log" Jun 14 20:36:16.823164 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:16.823121 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s89wg_a6c8e039-d630-4faf-83ec-d62d4766fe18/payload-pre-processing/0.log" Jun 14 20:36:16.843629 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:16.843607 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-nw79l_eaa6e598-abd6-4c1c-86a0-5d3e130552b5/payload-processing/0.log" Jun 14 20:36:17.455215 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:17.455184 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9hc7f_aea2eb77-e8ec-40e4-b060-6f64b7114c40/serve-healthcheck-canary/0.log" Jun 14 20:36:17.960941 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:17.960915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-77rjc_a23e54a1-88d8-49f2-b58c-6de52aad2100/insights-operator/0.log" Jun 14 20:36:17.961314 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:17.961045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-77rjc_a23e54a1-88d8-49f2-b58c-6de52aad2100/insights-operator/1.log" Jun 14 20:36:18.023179 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:18.023141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stztx_943fec76-26ad-47a3-a927-51868d42d90e/kube-rbac-proxy/0.log" Jun 14 20:36:18.041508 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:18.041487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stztx_943fec76-26ad-47a3-a927-51868d42d90e/exporter/0.log" Jun 14 20:36:18.054001 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:18.053984 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stztx_943fec76-26ad-47a3-a927-51868d42d90e/extractor/0.log" Jun 14 20:36:20.349163 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:20.349113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8b7449957-5frfx_f5441195-c0bc-449a-a259-1cfcdf5c2956/manager/0.log" Jun 14 20:36:20.531790 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:20.531768 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-t99j2_d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc/manager/0.log" Jun 14 20:36:20.545645 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:20.545623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cf7969f6-t99j2_d23ad5e2-1fb8-46c3-b1e6-3adf25cd3bbc/copy-manifests/0.log" Jun 14 20:36:20.869865 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:20.869842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xbsqn/perf-node-gather-daemonset-ptgnk" Jun 14 20:36:22.009692 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:22.009657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cc48dd6f6-bww2j_c02000ed-e6a9-4b16-a725-387faabe4b7e/manager/0.log" Jun 14 20:36:27.287043 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:27.287009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-qmmh6_ef1fad4c-2ba4-4536-8b69-822cd6351cc7/migrator/0.log" Jun 14 20:36:27.303610 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:27.303590 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-qmmh6_ef1fad4c-2ba4-4536-8b69-822cd6351cc7/graceful-termination/0.log" Jun 14 20:36:27.677749 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:27.677712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-67xsl_8e688020-223a-40a2-9296-3cdffc3a3bf3/kube-storage-version-migrator-operator/1.log" Jun 14 20:36:27.678777 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:27.678751 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-67xsl_8e688020-223a-40a2-9296-3cdffc3a3bf3/kube-storage-version-migrator-operator/0.log" Jun 14 20:36:28.043568 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:28.043541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-28mkb_0d7e95b0-e191-421e-9a35-f30d435cef15/kube-auth-proxy/0.log" Jun 14 20:36:28.087912 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:28.087891 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s89wg_a6c8e039-d630-4faf-83ec-d62d4766fe18/payload-pre-processing/0.log" Jun 14 20:36:28.101698 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:28.101662 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-nw79l_eaa6e598-abd6-4c1c-86a0-5d3e130552b5/payload-processing/0.log" Jun 14 20:36:29.052461 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.052434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/kube-multus-additional-cni-plugins/0.log" Jun 14 20:36:29.067503 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.067481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/egress-router-binary-copy/0.log" Jun 14 20:36:29.082060 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.082031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/cni-plugins/0.log" Jun 14 20:36:29.096762 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.096740 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/bond-cni-plugin/0.log" Jun 14 20:36:29.113079 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.113058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/routeoverride-cni/0.log" Jun 14 20:36:29.128105 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.128080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/whereabouts-cni-bincopy/0.log" Jun 14 20:36:29.146394 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.146373 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwkps_3145a829-0b59-463f-8fd0-9fafc5d4d9e0/whereabouts-cni/0.log" Jun 14 20:36:29.148281 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.148265 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-28mkb_0d7e95b0-e191-421e-9a35-f30d435cef15/kube-auth-proxy/0.log" Jun 14 20:36:29.173470 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.173447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n528f_45fcfb79-ee10-4aa2-ae77-fa94c896f73b/kube-multus/0.log" Jun 14 20:36:29.186083 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.186067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s89wg_a6c8e039-d630-4faf-83ec-d62d4766fe18/payload-pre-processing/0.log" Jun 14 20:36:29.200517 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.200500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-nw79l_eaa6e598-abd6-4c1c-86a0-5d3e130552b5/payload-processing/0.log" Jun 14 20:36:29.324038 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.323977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v6d4n_07ad4325-7ff9-49a6-916b-0b44d777fd96/network-metrics-daemon/0.log" Jun 14 20:36:29.339356 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:29.339336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v6d4n_07ad4325-7ff9-49a6-916b-0b44d777fd96/kube-rbac-proxy/0.log" Jun 14 20:36:30.291194 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.291162 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-controller/0.log" Jun 14 20:36:30.302779 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.302755 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/0.log" Jun 14 20:36:30.302942 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.302844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovn-acl-logging/1.log" Jun 14 20:36:30.318468 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.318446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/kube-rbac-proxy-node/0.log" Jun 14 20:36:30.334670 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.334648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/kube-rbac-proxy-ovn-metrics/0.log" Jun 14 20:36:30.347359 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.347341 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/northd/0.log" Jun 14 20:36:30.361482 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.361461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/nbdb/0.log" Jun 14 20:36:30.378879 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.378861 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/sbdb/0.log" Jun 14 20:36:30.418851 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.418807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g5xn5_14f6d87b-b0c1-4f7b-b140-c350dce18e94/ovnkube-controller/0.log" Jun 14 20:36:30.882926 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.882896 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686f9db88b-28mkb_0d7e95b0-e191-421e-9a35-f30d435cef15/kube-auth-proxy/0.log" Jun 14 20:36:30.930245 ip-10-0-129-240 kubenswrapper[2576]: I0614 20:36:30.930217 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s89wg_a6c8e039-d630-4faf-83ec-d62d4766fe18/payload-pre-processing/0.log"