Jul 08 16:03:48.318341 ip-10-0-136-114 systemd[1]: Starting Kubernetes Kubelet... Jul 08 16:03:50.194975 ip-10-0-136-114 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:03:50.194975 ip-10-0-136-114 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 16:03:50.194975 ip-10-0-136-114 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:03:50.194975 ip-10-0-136-114 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 16:03:50.194975 ip-10-0-136-114 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:03:50.196387 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.196283 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 16:03:50.200252 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200229 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.200252 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200247 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.200252 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200253 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.200252 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200257 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200265 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200271 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200276 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200280 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200284 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200288 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200291 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200295 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200299 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200303 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200308 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200313 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200317 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200321 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200325 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200329 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200333 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200337 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200341 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.200532 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200345 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200355 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200359 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200364 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200368 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200372 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200377 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200381 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200385 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200390 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200394 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200398 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200402 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200407 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200415 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200420 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200427 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200431 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200436 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200440 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.201404 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200444 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200448 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200453 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200459 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200463 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200467 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200472 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200476 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200481 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200486 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200490 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200495 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200501 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200506 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200510 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200514 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200520 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200527 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200531 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.202084 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200535 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200539 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200547 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200553 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200558 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200562 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200567 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200573 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200578 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200583 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200588 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200593 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200598 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200603 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200608 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200613 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200618 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200622 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200627 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.202625 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200632 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200636 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200640 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200645 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200649 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200654 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200658 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200665 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200671 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200676 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200681 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200686 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200691 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200695 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200700 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200704 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200709 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.200713 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202910 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202922 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.203493 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202927 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202933 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202941 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202949 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202955 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202960 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202965 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202970 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202974 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202979 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202984 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202988 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202993 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.202999 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203004 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203008 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203012 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203017 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203022 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203026 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.204383 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203030 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203035 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203040 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203044 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203049 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203053 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203058 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203062 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203067 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203071 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203076 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203080 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203085 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203090 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203094 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203098 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203128 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203134 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203138 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.205371 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203143 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203147 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203152 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203159 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203163 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203168 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203172 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203177 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203181 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203185 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203189 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203194 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203199 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203203 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203208 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203212 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203217 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203221 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203226 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203230 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.206314 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203234 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203239 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203244 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203249 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203253 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203258 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203262 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203267 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203271 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203277 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203284 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203289 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203293 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203298 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203303 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203308 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203313 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203317 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203322 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.206831 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203326 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203335 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203342 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203351 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203357 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203361 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203366 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203370 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203375 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203380 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203384 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203389 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203394 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203398 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203403 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203407 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203412 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203416 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.203420 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.207356 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204156 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204166 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204171 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204177 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204182 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204187 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204192 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204196 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204201 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204206 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204211 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204216 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204220 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204225 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204230 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204235 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204239 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204243 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204248 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204252 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.207873 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204257 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204261 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204266 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204271 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204277 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204282 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204287 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204291 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204298 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204303 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204308 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204313 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204317 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204322 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204327 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204332 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204336 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204342 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204347 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204352 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.208423 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204356 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204361 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204365 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204370 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204374 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204379 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204383 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204387 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204391 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204396 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204400 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204404 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204409 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204413 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204418 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204423 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204427 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204432 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204436 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204441 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.208918 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204445 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204450 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204454 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204459 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204463 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204469 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204476 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204483 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204489 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204494 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204499 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204505 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204509 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204514 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204518 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204525 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204529 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204534 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204539 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.209450 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204543 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204550 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204556 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204562 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204567 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204572 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204576 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204581 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204586 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204591 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204597 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204601 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204606 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204611 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204615 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204620 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204624 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204629 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204633 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.204638 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.209942 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204757 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204769 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204779 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204787 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204796 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204801 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204809 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204816 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204822 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204827 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204834 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204839 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204844 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204849 2572 flags.go:64] FLAG: --cgroup-root="" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204854 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204860 2572 flags.go:64] FLAG: --client-ca-file="" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204865 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204871 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204879 2572 flags.go:64] FLAG: --cluster-domain="" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204885 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204890 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204896 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204907 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204914 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 16:03:50.210468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204920 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204925 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204931 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204936 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204941 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204946 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204952 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204957 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204966 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204971 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204976 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204981 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204987 2572 flags.go:64] FLAG: --enable-server="true" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.204993 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205000 2572 flags.go:64] FLAG: --event-burst="100" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205006 2572 flags.go:64] FLAG: --event-qps="50" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205011 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205016 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205021 2572 flags.go:64] FLAG: --eviction-hard="" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205028 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205033 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205038 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205043 2572 flags.go:64] FLAG: --eviction-soft="" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205048 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205054 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 16:03:50.211058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205059 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205065 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205069 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205074 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205080 2572 flags.go:64] FLAG: --feature-gates="" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205089 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205094 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205099 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205105 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205129 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205135 2572 flags.go:64] FLAG: --help="false" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205141 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205146 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205151 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205157 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205165 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205171 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205176 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205181 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205186 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205191 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205204 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205210 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205215 2572 flags.go:64] FLAG: --kube-reserved="" Jul 08 16:03:50.211744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205220 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205225 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205230 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205235 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205240 2572 flags.go:64] FLAG: --lock-file="" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205245 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205250 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205256 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205266 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205271 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205276 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205281 2572 flags.go:64] FLAG: --logging-format="text" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205286 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205294 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205300 2572 flags.go:64] FLAG: --manifest-url="" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205305 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205312 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205317 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205324 2572 flags.go:64] FLAG: --max-pods="110" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205329 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205335 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205339 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205344 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205351 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205358 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 16:03:50.212446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205363 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205376 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205381 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205386 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205391 2572 flags.go:64] FLAG: --pod-cidr="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205397 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205406 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205411 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205416 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205421 2572 flags.go:64] FLAG: --port="10250" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205426 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205431 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08b275cf6fb6f5ce5" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205437 2572 flags.go:64] FLAG: --qos-reserved="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205442 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205447 2572 flags.go:64] FLAG: --register-node="true" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205452 2572 flags.go:64] FLAG: --register-with-taints="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205459 2572 flags.go:64] FLAG: --registry-burst="10" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205463 2572 flags.go:64] FLAG: --registry-qps="5" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205468 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205473 2572 flags.go:64] FLAG: --reserved-memory="" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205480 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205487 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205492 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205497 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205502 2572 flags.go:64] FLAG: --runonce="false" Jul 08 16:03:50.213632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205507 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205512 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205518 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205522 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205527 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205533 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205538 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205544 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205549 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205554 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205560 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205565 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205570 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205577 2572 flags.go:64] FLAG: --system-cgroups="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205582 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205591 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205596 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205601 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205610 2572 flags.go:64] FLAG: --tls-min-version="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205615 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205620 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205625 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205630 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205634 2572 flags.go:64] FLAG: --v="2" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205641 2572 flags.go:64] FLAG: --version="false" Jul 08 16:03:50.214783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205648 2572 flags.go:64] FLAG: --vmodule="" Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205655 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.205661 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205863 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205870 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205875 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205880 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205885 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205890 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205896 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205901 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205906 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205911 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205915 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205920 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205925 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205929 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205935 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205940 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205946 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.215919 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205951 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205957 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205961 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205966 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205970 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205975 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205979 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205984 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205988 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205993 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.205997 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206002 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206006 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206011 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206015 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206022 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206027 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206032 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206036 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206041 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.216966 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206045 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206050 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206055 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206060 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206064 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206069 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206074 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206078 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206083 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206087 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206092 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206099 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206105 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206128 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206143 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206148 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206153 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206157 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206162 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.217645 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206167 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206171 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206176 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206181 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206185 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206189 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206194 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206198 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206204 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206209 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206213 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206218 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206225 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206231 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206239 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206245 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206250 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206254 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206259 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206263 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.218462 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206268 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206273 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206277 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206282 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206286 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206293 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206299 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206304 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206310 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206315 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206344 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206371 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206375 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206379 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206382 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206387 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206390 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206393 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206397 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.219359 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206400 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206403 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206407 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.206410 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.206417 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.215451 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.215468 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.215496 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.215506 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215609 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215617 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215623 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215628 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215633 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215638 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.219969 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215645 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215650 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215655 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215660 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215665 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215672 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215678 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215683 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215689 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215694 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215699 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215703 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215709 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215714 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215718 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215723 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215727 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215732 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215736 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.220627 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215741 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215754 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215760 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215765 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215769 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215774 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215778 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215782 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215787 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215792 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215797 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215801 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215806 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215813 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215819 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215824 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215829 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215835 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215840 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.221151 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215845 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215850 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215855 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215860 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215864 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215869 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215874 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215879 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215884 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215888 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215893 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215897 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215902 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215906 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215911 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215921 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215925 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215930 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215934 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215938 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.221664 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215942 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215947 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215951 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215956 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215960 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215965 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215970 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215975 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215979 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215984 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215989 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215993 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.215997 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216002 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216006 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216010 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216015 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216019 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216024 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216028 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.222207 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216033 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216037 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216042 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216048 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216054 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216059 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216064 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216068 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216081 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216086 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216090 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216095 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216099 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216104 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216125 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.222757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.216134 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216402 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216412 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216431 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216437 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216442 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216447 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216452 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216457 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216461 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216466 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216471 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216476 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216481 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216486 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216490 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216494 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216499 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216503 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:03:50.223204 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216508 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216512 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216517 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216521 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216526 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216530 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216535 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216547 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216552 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216556 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216564 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216570 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216576 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216581 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216586 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216592 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216597 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216617 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216622 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216627 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:03:50.223768 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216632 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216636 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216641 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216645 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216649 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216654 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216658 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216662 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216667 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216672 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216676 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216681 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216685 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216689 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216694 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216698 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216703 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216707 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216712 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:03:50.224367 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216719 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216733 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216739 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216744 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216753 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216757 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216762 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216770 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216774 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216779 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216783 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216788 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216793 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216797 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216802 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216806 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216810 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216815 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216820 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:03:50.224924 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216824 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216828 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216833 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216837 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216842 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216846 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216851 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216855 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216862 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216868 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216872 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216877 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216881 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216885 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216898 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216903 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216908 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216912 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216916 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:03:50.225770 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216921 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216927 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:50.216932 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.216941 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.217141 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.220212 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.222191 2572 server.go:1019] "Starting client certificate rotation" Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.222305 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:03:50.226529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.222339 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:03:50.227089 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.227051 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:03:50.230640 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.230620 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:03:50.241075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.241055 2572 log.go:25] "Validated CRI v1 runtime API" Jul 08 16:03:50.243588 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.243571 2572 log.go:25] "Validated CRI v1 image API" Jul 08 16:03:50.244621 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.244605 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 16:03:50.247906 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.247885 2572 fs.go:135] Filesystem UUIDs: map[6d007c77-e4e9-48cd-9562-d4715b751eda:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e6101c9d-4941-43e8-9db0-44d1ad37dc1b:/dev/nvme0n1p3] Jul 08 16:03:50.247971 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.247905 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 16:03:50.253663 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.253530 2572 manager.go:216] Machine: {Timestamp:2026-07-08 16:03:50.252198174 +0000 UTC m=+1.834070679 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100698 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec257d5c5af0c0bdae171dc3c5500573 SystemUUID:ec257d5c-5af0-c0bd-ae17-1dc3c5500573 BootID:7fb29cf5-36d1-4d86-8353-dca1ce34ce94 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:58:ee:44:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:58:ee:44:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:e2:52:0a:fe:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 16:03:50.253663 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.253646 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 16:03:50.253791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.253775 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:03:50.253791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.253778 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 16:03:50.256693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.256661 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 16:03:50.256878 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.256696 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 16:03:50.257412 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.257400 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 16:03:50.257491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.257415 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 16:03:50.257491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.257423 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:03:50.258717 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.258705 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:03:50.260097 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.260086 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 16:03:50.264434 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264391 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:03:50.264531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264521 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 16:03:50.264570 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264562 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 08 16:03:50.264622 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264581 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 16:03:50.264622 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264613 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 16:03:50.264697 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264624 2572 kubelet.go:398] "Adding apiserver pod source" Jul 08 16:03:50.264697 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.264641 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 16:03:50.265075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.265056 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:03:50.265137 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.265083 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:03:50.267189 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.267168 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 16:03:50.269694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.269668 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 16:03:50.269796 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.269723 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 16:03:50.271169 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271137 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 16:03:50.271404 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271388 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 16:03:50.271485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271408 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 16:03:50.271485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271420 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 16:03:50.271485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271442 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 16:03:50.271485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271457 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271492 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271507 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271537 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271560 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271593 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 16:03:50.271617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.271609 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 16:03:50.272308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.272292 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 16:03:50.272535 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.272523 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 16:03:50.275957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.275943 2572 server.go:1268] "Started kubelet" Jul 08 16:03:50.276074 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.276043 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 16:03:50.276171 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.276036 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 16:03:50.276171 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.276124 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 16:03:50.276650 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.276628 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 16:03:50.276936 ip-10-0-136-114 systemd[1]: Started Kubernetes Kubelet. Jul 08 16:03:50.277625 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.277112 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 16:03:50.277625 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.277110 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 16:03:50.278815 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.278798 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 08 16:03:50.280643 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.280626 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 16:03:50.280718 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.280618 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 16:03:50.281452 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.280545 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-114.ec2.internal.18c05c054d0b97c2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-114.ec2.internal,UID:ip-10-0-136-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-114.ec2.internal,},FirstTimestamp:2026-07-08 16:03:50.275913666 +0000 UTC m=+1.857786171,LastTimestamp:2026-07-08 16:03:50.275913666 +0000 UTC m=+1.857786171,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-114.ec2.internal,}" Jul 08 16:03:50.283598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.283579 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4n8r" Jul 08 16:03:50.285948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.285924 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 16:03:50.286022 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.285947 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 16:03:50.286074 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.286024 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.286521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.286486 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 16:03:50.286521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.286505 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 16:03:50.286642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.286546 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 16:03:50.286642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.286641 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 08 16:03:50.286734 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.286649 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 08 16:03:50.287440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287422 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 16:03:50.287440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287439 2572 factory.go:55] Registering systemd factory Jul 08 16:03:50.287553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287450 2572 factory.go:223] Registration of the systemd container factory successfully Jul 08 16:03:50.287663 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287652 2572 factory.go:153] Registering CRI-O factory Jul 08 16:03:50.287730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287666 2572 factory.go:223] Registration of the crio container factory successfully Jul 08 16:03:50.287730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287689 2572 factory.go:103] Registering Raw factory Jul 08 16:03:50.287730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.287705 2572 manager.go:1196] Started watching for new ooms in manager Jul 08 16:03:50.288240 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.288222 2572 manager.go:349] Starting recovery of all containers Jul 08 16:03:50.288504 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.288394 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 16:03:50.288589 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.288502 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 16:03:50.290572 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.290548 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f4n8r" Jul 08 16:03:50.295550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.295273 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 16:03:50.297531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.297504 2572 manager.go:354] Recovery completed Jul 08 16:03:50.304486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.304470 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.306600 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.306577 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.306672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.306619 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.306672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.306631 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.307333 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.307316 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 16:03:50.307333 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.307331 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.307485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.307331 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 16:03:50.307485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.307386 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:03:50.308209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.308192 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.308298 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.308226 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.308298 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.308239 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.309739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.309718 2572 policy_none.go:49] "None policy: Start" Jul 08 16:03:50.309739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.309739 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 16:03:50.309847 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.309750 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 16:03:50.311948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.311926 2572 policy_none.go:47] "Start" Jul 08 16:03:50.353923 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.353708 2572 manager.go:337] "Starting Device Plugin manager" Jul 08 16:03:50.354019 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.353942 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 16:03:50.354019 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.353955 2572 server.go:87] "Starting device plugin registration server" Jul 08 16:03:50.354221 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.354209 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 16:03:50.354253 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.354225 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 16:03:50.354362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.354341 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 16:03:50.354448 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.354432 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 16:03:50.354448 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.354447 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 16:03:50.354996 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.354976 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 16:03:50.355091 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.355033 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.455994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.455939 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.458251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.457040 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.458251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.457092 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.458251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.457106 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.458251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.457136 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.464441 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.464408 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 16:03:50.464537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.464451 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 16:03:50.464537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.464472 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 16:03:50.464537 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.464503 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 16:03:50.467165 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.467149 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.467251 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.467171 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-114.ec2.internal\": node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.467559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.467545 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:03:50.527997 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.527905 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.566311 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.566262 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal"] Jul 08 16:03:50.566423 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.566367 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.568143 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.568124 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.568258 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.568160 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.568258 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.568176 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.570440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.570423 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.570538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.570517 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.570604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.570546 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.571252 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571237 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.571369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571254 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.571369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571268 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.571369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571274 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.571369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571284 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.571564 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.571287 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.573624 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.573603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.573713 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.573641 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:03:50.574398 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.574381 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:03:50.574461 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.574418 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:03:50.574461 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.574437 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:03:50.588463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.588437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86a3528a3f56534f647f2afc26d1f80b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-114.ec2.internal\" (UID: \"86a3528a3f56534f647f2afc26d1f80b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.588463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.588465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.588622 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.588487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.598104 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.598077 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-114.ec2.internal\" not found" node="ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.602920 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.602901 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-114.ec2.internal\" not found" node="ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.628401 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.628373 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.688879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.688844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.688879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.688877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.689153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.688901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86a3528a3f56534f647f2afc26d1f80b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-114.ec2.internal\" (UID: \"86a3528a3f56534f647f2afc26d1f80b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.689153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.688944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.689153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.688981 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/86a3528a3f56534f647f2afc26d1f80b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-114.ec2.internal\" (UID: \"86a3528a3f56534f647f2afc26d1f80b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.689153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.689006 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be705dfd14987f99ad404ea217ebfdbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal\" (UID: \"be705dfd14987f99ad404ea217ebfdbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.729611 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.729581 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.833075 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.833008 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:50.901598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.901565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.907700 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:50.906939 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:50.934260 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:50.934223 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.037341 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.037290 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.139754 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.139659 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.221556 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.221525 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 16:03:51.222050 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.221677 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 16:03:51.240243 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.240211 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.295997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.295943 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:58:50 +0000 UTC" deadline="2028-02-14 07:48:45.713364575 +0000 UTC" Jul 08 16:03:51.295997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.295987 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14055h44m54.417381111s" Jul 08 16:03:51.340628 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.340593 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.441591 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.441522 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.442016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.441998 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:03:51.504152 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:51.504112 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a3528a3f56534f647f2afc26d1f80b.slice/crio-356cf70715b0a2e96bfe4d30e823e9fda9746cefe016b46241d17e46733a7b20 WatchSource:0}: Error finding container 356cf70715b0a2e96bfe4d30e823e9fda9746cefe016b46241d17e46733a7b20: Status 404 returned error can't find the container with id 356cf70715b0a2e96bfe4d30e823e9fda9746cefe016b46241d17e46733a7b20 Jul 08 16:03:51.509097 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.509080 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:03:51.542466 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.542431 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.625510 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:51.625482 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe705dfd14987f99ad404ea217ebfdbd.slice/crio-f0fc47e45ea18a6dfffc5358cc3e1383d93d7aba38c78dd1d7ecd118c72b5c18 WatchSource:0}: Error finding container f0fc47e45ea18a6dfffc5358cc3e1383d93d7aba38c78dd1d7ecd118c72b5c18: Status 404 returned error can't find the container with id f0fc47e45ea18a6dfffc5358cc3e1383d93d7aba38c78dd1d7ecd118c72b5c18 Jul 08 16:03:51.643277 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:51.643237 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-114.ec2.internal\" not found" Jul 08 16:03:51.731171 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.731085 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:03:51.786951 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.786910 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" Jul 08 16:03:51.803908 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.803877 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:03:51.804876 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.804859 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" Jul 08 16:03:51.815204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.815182 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:03:51.823513 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:51.823490 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:03:52.218202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.218120 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:03:52.266529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.266499 2572 apiserver.go:52] "Watching apiserver" Jul 08 16:03:52.275723 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.275696 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 16:03:52.276845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.276818 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-b2htp","kube-system/konnectivity-agent-fr229","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs","openshift-cluster-node-tuning-operator/tuned-6gjnr","openshift-dns/node-resolver-6vbnm","openshift-network-diagnostics/network-check-target-ppbqf","openshift-ovn-kubernetes/ovnkube-node-26bt2","kube-system/global-pull-secret-syncer-wtqbv","kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal","openshift-image-registry/node-ca-xvtw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal","openshift-multus/multus-7t2kp","openshift-multus/multus-additional-cni-plugins-k8vlz","openshift-multus/network-metrics-daemon-xqx9p"] Jul 08 16:03:52.279505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.279482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.281759 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.281738 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.283117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283085 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 16:03:52.283117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283103 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 16:03:52.283262 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283129 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.283314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283277 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tqf7x\"" Jul 08 16:03:52.283314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283298 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.283589 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283574 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 16:03:52.283764 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.283742 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 16:03:52.284393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284376 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.284484 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284376 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 16:03:52.284542 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284482 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.284655 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 16:03:52.284830 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284814 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 16:03:52.284902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.284866 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.285369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.285353 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dk68r\"" Jul 08 16:03:52.286572 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.286553 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 16:03:52.287583 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.287564 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 16:03:52.288063 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.288045 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.288063 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.288061 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x462d\"" Jul 08 16:03:52.288338 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.288323 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.288795 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.288781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.291319 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.291304 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.292063 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.292048 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.292648 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.292634 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.292788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.292775 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tqcc9\"" Jul 08 16:03:52.293862 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.293842 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:52.293978 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.293951 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:03:52.294271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.294252 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.294271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.294263 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.295836 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.295814 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z7xwj\"" Jul 08 16:03:52.296345 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.296327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.296425 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.296397 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:03:52.298872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.298851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-sys-fs\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.298950 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.298914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.298950 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.298930 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysconfig\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.298968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-conf\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.298996 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-systemd-units\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-etc-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-node-log\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.299227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.299227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-registration-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.299227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbs88\" (UniqueName: \"kubernetes.io/projected/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-kube-api-access-hbs88\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-bin\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-socket-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h95qg\" (UniqueName: \"kubernetes.io/projected/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kube-api-access-h95qg\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-run\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-kubelet\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-slash\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-systemd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-var-lib-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-modprobe-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299600 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-systemd\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-ovn\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299693 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-netd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dssfs\" (UniqueName: \"kubernetes.io/projected/f543f4a7-9a15-47dd-9a96-b175d023857d-kube-api-access-dssfs\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.299767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-system-cni-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-cnibin\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-device-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-kubernetes\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-lib-modules\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-var-lib-kubelet\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-tuned\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-tmp\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.299994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300046 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-config\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f543f4a7-9a15-47dd-9a96-b175d023857d-ovn-node-metrics-cert\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-script-lib\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-os-release\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300231 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-host\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-log-socket\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-env-overrides\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/72823315-3130-4009-ac3d-e3b1eadd8e84-kube-api-access-pxn9t\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-sys\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.300894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.300404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-netns\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.303747 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.303433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.304525 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.304507 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.305250 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.305231 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.305533 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.305518 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.305768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.305753 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 16:03:52.306752 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.306735 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 16:03:52.306843 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.306811 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4ftsg\"" Jul 08 16:03:52.307136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.307227 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.307196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:03:52.307327 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307306 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307545 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307570 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307619 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b9wbw\"" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307626 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rdr6c\"" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307643 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 16:03:52.307737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.307645 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 16:03:52.309768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.309747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.312789 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.312769 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 16:03:52.315491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.315473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hg56\"" Jul 08 16:03:52.366020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.365983 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzkf" Jul 08 16:03:52.379836 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.379808 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6pzkf" Jul 08 16:03:52.388706 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.388680 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 16:03:52.400591 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-multus\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.400772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7205266f-f9b5-427e-ac93-5545dc478fa7-tmp-dir\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.400772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b3dea69-0b99-490d-a1cd-e70276215f9e-serviceca\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.400772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-dbus\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.400772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-env-overrides\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.400772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-bin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400905 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-netns\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400922 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-host-slash\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-kubelet\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-hostroot\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400976 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-netns\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.400986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-etc-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-iptables-alerter-script\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.401031 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401028 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-etc-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-daemon-config\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-registration-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-bin\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-registration-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-socket-dir-parent\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401226 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-bin\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-socket-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-systemd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-var-lib-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-systemd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dssfs\" (UniqueName: \"kubernetes.io/projected/f543f4a7-9a15-47dd-9a96-b175d023857d-kube-api-access-dssfs\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401354 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-env-overrides\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.401540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/1b3dea69-0b99-490d-a1cd-e70276215f9e-kube-api-access-7gngt\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401384 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-etc-selinux\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401357 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-var-lib-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401399 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-socket-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/742d552f-053e-4b3c-8cca-7c961b8e60a1-agent-certs\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401441 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cnibin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/72823315-3130-4009-ac3d-e3b1eadd8e84-kube-api-access-pxn9t\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-systemd\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-ovn\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-system-cni-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4cn\" (UniqueName: \"kubernetes.io/projected/e5f2c980-d091-4f8a-9d1b-02a65eee3884-kube-api-access-5s4cn\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-system-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-netns\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401566 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-systemd\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fcvd\" (UniqueName: \"kubernetes.io/projected/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-kube-api-access-5fcvd\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-lib-modules\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401615 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-ovn\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.402379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401633 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-var-lib-kubelet\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-system-cni-dir\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-tuned\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-tmp\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401684 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-var-lib-kubelet\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-kubelet-config\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401755 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-lib-modules\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401801 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-config\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f543f4a7-9a15-47dd-9a96-b175d023857d-ovn-node-metrics-cert\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401840 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-os-release\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401859 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cni-binary-copy\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.401959 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403130 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-config\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-host\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402627 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-os-release\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-log-socket\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q728\" (UniqueName: \"kubernetes.io/projected/7205266f-f9b5-427e-ac93-5545dc478fa7-kube-api-access-7q728\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-host\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-sys\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-log-socket\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr6ww\" (UniqueName: \"kubernetes.io/projected/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-kube-api-access-gr6ww\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402744 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-sys\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-multus-certs\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-sys-fs\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-sys-fs\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysconfig\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-conf\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-systemd-units\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.403966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402965 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysconfig\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.402989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-node-log\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-systemd-units\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7205266f-f9b5-427e-ac93-5545dc478fa7-hosts-file\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403042 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-node-log\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbs88\" (UniqueName: \"kubernetes.io/projected/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-kube-api-access-hbs88\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403088 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-sysctl-conf\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b3dea69-0b99-490d-a1cd-e70276215f9e-host\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-k8s-cni-cncf-io\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-etc-kubernetes\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h95qg\" (UniqueName: \"kubernetes.io/projected/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kube-api-access-h95qg\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-run\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403299 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-kubelet\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-slash\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403377 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-slash\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.404693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-kubelet\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-netd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-run\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403449 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-cnibin\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-cni-netd\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-modprobe-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72823315-3130-4009-ac3d-e3b1eadd8e84-cnibin\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403543 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403572 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/742d552f-053e-4b3c-8cca-7c961b8e60a1-konnectivity-ca\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-run-openvswitch\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-conf-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403567 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-modprobe-d\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-device-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403657 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-kubernetes\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-script-lib\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.405352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-device-dir\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f543f4a7-9a15-47dd-9a96-b175d023857d-host-run-ovn-kubernetes\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-os-release\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403890 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.403922 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-kubernetes\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.404079 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-binary-copy\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.404224 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72823315-3130-4009-ac3d-e3b1eadd8e84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.404431 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f543f4a7-9a15-47dd-9a96-b175d023857d-ovnkube-script-lib\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.405437 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-tmp\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.405474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-etc-tuned\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.406314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.405487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f543f4a7-9a15-47dd-9a96-b175d023857d-ovn-node-metrics-cert\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.418217 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.418187 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxn9t\" (UniqueName: \"kubernetes.io/projected/72823315-3130-4009-ac3d-e3b1eadd8e84-kube-api-access-pxn9t\") pod \"multus-additional-cni-plugins-k8vlz\" (UID: \"72823315-3130-4009-ac3d-e3b1eadd8e84\") " pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.419862 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.419837 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h95qg\" (UniqueName: \"kubernetes.io/projected/ebc67e7f-38bc-4641-ac27-36cdc9074e2f-kube-api-access-h95qg\") pod \"aws-ebs-csi-driver-node-2g8cs\" (UID: \"ebc67e7f-38bc-4641-ac27-36cdc9074e2f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.420182 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.420160 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbs88\" (UniqueName: \"kubernetes.io/projected/339909d4-d91c-43ff-a2d2-2297a3d2e0f7-kube-api-access-hbs88\") pod \"tuned-6gjnr\" (UID: \"339909d4-d91c-43ff-a2d2-2297a3d2e0f7\") " pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.421641 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.421609 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dssfs\" (UniqueName: \"kubernetes.io/projected/f543f4a7-9a15-47dd-9a96-b175d023857d-kube-api-access-dssfs\") pod \"ovnkube-node-26bt2\" (UID: \"f543f4a7-9a15-47dd-9a96-b175d023857d\") " pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.471612 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.471498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" event={"ID":"be705dfd14987f99ad404ea217ebfdbd","Type":"ContainerStarted","Data":"f0fc47e45ea18a6dfffc5358cc3e1383d93d7aba38c78dd1d7ecd118c72b5c18"} Jul 08 16:03:52.472938 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.472905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" event={"ID":"86a3528a3f56534f647f2afc26d1f80b","Type":"ContainerStarted","Data":"356cf70715b0a2e96bfe4d30e823e9fda9746cefe016b46241d17e46733a7b20"} Jul 08 16:03:52.505052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.504993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-kubelet-config\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.505052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cni-binary-copy\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q728\" (UniqueName: \"kubernetes.io/projected/7205266f-f9b5-427e-ac93-5545dc478fa7-kube-api-access-7q728\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr6ww\" (UniqueName: \"kubernetes.io/projected/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-kube-api-access-gr6ww\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-multus-certs\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7205266f-f9b5-427e-ac93-5545dc478fa7-hosts-file\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b3dea69-0b99-490d-a1cd-e70276215f9e-host\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505180 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-kubelet-config\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-k8s-cni-cncf-io\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-etc-kubernetes\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505260 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-k8s-cni-cncf-io\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505307 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-etc-kubernetes\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:52.505315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505320 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-multus-certs\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505368 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/742d552f-053e-4b3c-8cca-7c961b8e60a1-konnectivity-ca\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-conf-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-os-release\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-multus\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-conf-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505559 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-os-release\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505591 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-multus\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b3dea69-0b99-490d-a1cd-e70276215f9e-host\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7205266f-f9b5-427e-ac93-5545dc478fa7-tmp-dir\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b3dea69-0b99-490d-a1cd-e70276215f9e-serviceca\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7205266f-f9b5-427e-ac93-5545dc478fa7-hosts-file\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-dbus\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-bin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-host-slash\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-kubelet\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-hostroot\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.505983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-iptables-alerter-script\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505867 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.505875 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-daemon-config\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505932 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cni-binary-copy\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7205266f-f9b5-427e-ac93-5545dc478fa7-tmp-dir\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505934 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-kubelet\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.505984 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:53.005932659 +0000 UTC m=+4.587805171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.506013 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505880 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74a247e1-67ea-48e8-a307-77250c689099-dbus\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.506064 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:53.006049353 +0000 UTC m=+4.587921859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506084 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/742d552f-053e-4b3c-8cca-7c961b8e60a1-konnectivity-ca\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-socket-dir-parent\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-var-lib-cni-bin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.505983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-host-slash\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.506853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-socket-dir-parent\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506161 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-hostroot\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/1b3dea69-0b99-490d-a1cd-e70276215f9e-kube-api-access-7gngt\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506252 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/742d552f-053e-4b3c-8cca-7c961b8e60a1-agent-certs\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506278 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cnibin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506224 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b3dea69-0b99-490d-a1cd-e70276215f9e-serviceca\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-cnibin\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4cn\" (UniqueName: \"kubernetes.io/projected/e5f2c980-d091-4f8a-9d1b-02a65eee3884-kube-api-access-5s4cn\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506411 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-system-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-netns\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-multus-daemon-config\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fcvd\" (UniqueName: \"kubernetes.io/projected/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-kube-api-access-5fcvd\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506564 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-host-run-netns\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506576 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-system-cni-dir\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.507636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.506618 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-iptables-alerter-script\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.509084 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.509050 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/742d552f-053e-4b3c-8cca-7c961b8e60a1-agent-certs\") pod \"konnectivity-agent-fr229\" (UID: \"742d552f-053e-4b3c-8cca-7c961b8e60a1\") " pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.520931 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.520745 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:03:52.520931 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.520775 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:03:52.520931 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.520793 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:52.520931 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:52.520881 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:53.02085942 +0000 UTC m=+4.602731937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:52.521740 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.521708 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr6ww\" (UniqueName: \"kubernetes.io/projected/af65c777-0efd-4b1c-9ac8-e2f848bc11d4-kube-api-access-gr6ww\") pod \"iptables-alerter-b2htp\" (UID: \"af65c777-0efd-4b1c-9ac8-e2f848bc11d4\") " pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.522052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.522013 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4cn\" (UniqueName: \"kubernetes.io/projected/e5f2c980-d091-4f8a-9d1b-02a65eee3884-kube-api-access-5s4cn\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:52.522935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.522893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q728\" (UniqueName: \"kubernetes.io/projected/7205266f-f9b5-427e-ac93-5545dc478fa7-kube-api-access-7q728\") pod \"node-resolver-6vbnm\" (UID: \"7205266f-f9b5-427e-ac93-5545dc478fa7\") " pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.523923 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.523898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fcvd\" (UniqueName: \"kubernetes.io/projected/086077ba-ff82-4f8c-8fb9-a06fbc99a8d4-kube-api-access-5fcvd\") pod \"multus-7t2kp\" (UID: \"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4\") " pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.530841 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.530816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gngt\" (UniqueName: \"kubernetes.io/projected/1b3dea69-0b99-490d-a1cd-e70276215f9e-kube-api-access-7gngt\") pod \"node-ca-xvtw4\" (UID: \"1b3dea69-0b99-490d-a1cd-e70276215f9e\") " pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.590749 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.590712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:03:52.597515 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.597488 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" Jul 08 16:03:52.603466 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.603435 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf543f4a7_9a15_47dd_9a96_b175d023857d.slice/crio-bfee0748933c255958bf48098b70a153c948dc4f5772a054e1c933e0595d4a72 WatchSource:0}: Error finding container bfee0748933c255958bf48098b70a153c948dc4f5772a054e1c933e0595d4a72: Status 404 returned error can't find the container with id bfee0748933c255958bf48098b70a153c948dc4f5772a054e1c933e0595d4a72 Jul 08 16:03:52.607823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.607796 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" Jul 08 16:03:52.609265 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.609223 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72823315_3130_4009_ac3d_e3b1eadd8e84.slice/crio-9adf0453b2ee163459484ba617a6ca6218ac4c0a8b167c812ad475c7d67968b9 WatchSource:0}: Error finding container 9adf0453b2ee163459484ba617a6ca6218ac4c0a8b167c812ad475c7d67968b9: Status 404 returned error can't find the container with id 9adf0453b2ee163459484ba617a6ca6218ac4c0a8b167c812ad475c7d67968b9 Jul 08 16:03:52.612901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.612877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" Jul 08 16:03:52.618884 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.618860 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vbnm" Jul 08 16:03:52.619115 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.619084 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc67e7f_38bc_4641_ac27_36cdc9074e2f.slice/crio-eeb459e7ff9f8b7975fab8bbeb1be5ba305e904a73c6b35676a0e1a10cd8ccf5 WatchSource:0}: Error finding container eeb459e7ff9f8b7975fab8bbeb1be5ba305e904a73c6b35676a0e1a10cd8ccf5: Status 404 returned error can't find the container with id eeb459e7ff9f8b7975fab8bbeb1be5ba305e904a73c6b35676a0e1a10cd8ccf5 Jul 08 16:03:52.623982 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.623950 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339909d4_d91c_43ff_a2d2_2297a3d2e0f7.slice/crio-03e21a89eecd1046afbd4717ab9a7e34b6561119a3926654659084d8b1a59910 WatchSource:0}: Error finding container 03e21a89eecd1046afbd4717ab9a7e34b6561119a3926654659084d8b1a59910: Status 404 returned error can't find the container with id 03e21a89eecd1046afbd4717ab9a7e34b6561119a3926654659084d8b1a59910 Jul 08 16:03:52.625793 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.625777 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2htp" Jul 08 16:03:52.630109 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.630087 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7205266f_f9b5_427e_ac93_5545dc478fa7.slice/crio-9f5c87716b302aadc3b579e3c5c727f19419e3c94ea8687efe56c38d67268545 WatchSource:0}: Error finding container 9f5c87716b302aadc3b579e3c5c727f19419e3c94ea8687efe56c38d67268545: Status 404 returned error can't find the container with id 9f5c87716b302aadc3b579e3c5c727f19419e3c94ea8687efe56c38d67268545 Jul 08 16:03:52.631614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.631567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:03:52.637222 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.637188 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf65c777_0efd_4b1c_9ac8_e2f848bc11d4.slice/crio-bf529219e4997b15cd1b0a2b60538380ccee394179bfab8fd8475475b6e62cfa WatchSource:0}: Error finding container bf529219e4997b15cd1b0a2b60538380ccee394179bfab8fd8475475b6e62cfa: Status 404 returned error can't find the container with id bf529219e4997b15cd1b0a2b60538380ccee394179bfab8fd8475475b6e62cfa Jul 08 16:03:52.637311 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.637270 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvtw4" Jul 08 16:03:52.642223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:52.642207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7t2kp" Jul 08 16:03:52.643155 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.643085 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742d552f_053e_4b3c_8cca_7c961b8e60a1.slice/crio-c0101f04bd54bdce3c0970488a683d337f6571dc74a4a0a4ec842879ffdb0b75 WatchSource:0}: Error finding container c0101f04bd54bdce3c0970488a683d337f6571dc74a4a0a4ec842879ffdb0b75: Status 404 returned error can't find the container with id c0101f04bd54bdce3c0970488a683d337f6571dc74a4a0a4ec842879ffdb0b75 Jul 08 16:03:52.649980 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.649954 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3dea69_0b99_490d_a1cd_e70276215f9e.slice/crio-4d1fe685571c1e821fa1ebc11a261608edc9373b1d7c99e46c531a64a2aca906 WatchSource:0}: Error finding container 4d1fe685571c1e821fa1ebc11a261608edc9373b1d7c99e46c531a64a2aca906: Status 404 returned error can't find the container with id 4d1fe685571c1e821fa1ebc11a261608edc9373b1d7c99e46c531a64a2aca906 Jul 08 16:03:52.653242 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:03:52.653223 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086077ba_ff82_4f8c_8fb9_a06fbc99a8d4.slice/crio-dec1b88e345b2e338d03b5c013d3407b2298f647b8fee8c091dc50c50f66a0a0 WatchSource:0}: Error finding container dec1b88e345b2e338d03b5c013d3407b2298f647b8fee8c091dc50c50f66a0a0: Status 404 returned error can't find the container with id dec1b88e345b2e338d03b5c013d3407b2298f647b8fee8c091dc50c50f66a0a0 Jul 08 16:03:53.011941 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.011899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:53.011941 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.011946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:53.012199 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.012085 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:53.012199 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.012158 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.012142127 +0000 UTC m=+5.594014617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:53.012199 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.012089 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:53.012326 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.012207 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.01219638 +0000 UTC m=+5.594068873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:53.112467 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.112425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:53.112655 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.112639 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:03:53.112718 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.112667 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:03:53.112718 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.112682 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:53.112815 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:53.112753 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:54.112731813 +0000 UTC m=+5.694604304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:53.383915 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.383803 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:58:52 +0000 UTC" deadline="2028-01-10 23:16:05.867983564 +0000 UTC" Jul 08 16:03:53.383915 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.383862 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13231h12m12.484125505s" Jul 08 16:03:53.476595 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.476545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fr229" event={"ID":"742d552f-053e-4b3c-8cca-7c961b8e60a1","Type":"ContainerStarted","Data":"c0101f04bd54bdce3c0970488a683d337f6571dc74a4a0a4ec842879ffdb0b75"} Jul 08 16:03:53.477738 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.477701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2htp" event={"ID":"af65c777-0efd-4b1c-9ac8-e2f848bc11d4","Type":"ContainerStarted","Data":"bf529219e4997b15cd1b0a2b60538380ccee394179bfab8fd8475475b6e62cfa"} Jul 08 16:03:53.478879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.478853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vbnm" event={"ID":"7205266f-f9b5-427e-ac93-5545dc478fa7","Type":"ContainerStarted","Data":"9f5c87716b302aadc3b579e3c5c727f19419e3c94ea8687efe56c38d67268545"} Jul 08 16:03:53.480156 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.480133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" event={"ID":"ebc67e7f-38bc-4641-ac27-36cdc9074e2f","Type":"ContainerStarted","Data":"eeb459e7ff9f8b7975fab8bbeb1be5ba305e904a73c6b35676a0e1a10cd8ccf5"} Jul 08 16:03:53.481500 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.481475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"bfee0748933c255958bf48098b70a153c948dc4f5772a054e1c933e0595d4a72"} Jul 08 16:03:53.482773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.482747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7t2kp" event={"ID":"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4","Type":"ContainerStarted","Data":"dec1b88e345b2e338d03b5c013d3407b2298f647b8fee8c091dc50c50f66a0a0"} Jul 08 16:03:53.484098 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.484073 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" event={"ID":"339909d4-d91c-43ff-a2d2-2297a3d2e0f7","Type":"ContainerStarted","Data":"03e21a89eecd1046afbd4717ab9a7e34b6561119a3926654659084d8b1a59910"} Jul 08 16:03:53.485317 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.485294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerStarted","Data":"9adf0453b2ee163459484ba617a6ca6218ac4c0a8b167c812ad475c7d67968b9"} Jul 08 16:03:53.486660 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:53.486640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvtw4" event={"ID":"1b3dea69-0b99-490d-a1cd-e70276215f9e","Type":"ContainerStarted","Data":"4d1fe685571c1e821fa1ebc11a261608edc9373b1d7c99e46c531a64a2aca906"} Jul 08 16:03:54.020067 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.020028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:54.020218 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.020113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:54.020281 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.020209 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:54.020352 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.020277 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:54.020352 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.020348 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:56.020326789 +0000 UTC m=+7.602199306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:54.020471 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.020371 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:56.020360611 +0000 UTC m=+7.602233117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:54.121745 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.121464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:54.121935 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.121800 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:03:54.121935 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.121828 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:03:54.121935 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.121843 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:54.121935 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.121912 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:03:56.121892636 +0000 UTC m=+7.703765143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:54.385092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.384909 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:58:52 +0000 UTC" deadline="2028-01-23 06:13:04.750566573 +0000 UTC" Jul 08 16:03:54.385092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.384955 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13526h9m10.365616901s" Jul 08 16:03:54.467531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.467494 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:54.467704 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.467638 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:03:54.473218 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.468091 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:54.473218 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.468225 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:03:54.473218 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.468295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:54.473218 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:54.468370 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:03:54.516627 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:54.516583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" event={"ID":"86a3528a3f56534f647f2afc26d1f80b","Type":"ContainerStarted","Data":"e70335abea0fc3366e5c8a5da2d9c1dc5fe9691f1fe2a3c6fde05ea51a6a6d01"} Jul 08 16:03:55.546893 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:55.546849 2572 generic.go:356] "Generic (PLEG): container finished" podID="be705dfd14987f99ad404ea217ebfdbd" containerID="d5c1de6411b23ac115ee4a3487429b4ad8d7b62487cc3e0d6de5bc9621ba66d1" exitCode=0 Jul 08 16:03:55.548183 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:55.547949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" event={"ID":"be705dfd14987f99ad404ea217ebfdbd","Type":"ContainerDied","Data":"d5c1de6411b23ac115ee4a3487429b4ad8d7b62487cc3e0d6de5bc9621ba66d1"} Jul 08 16:03:55.569810 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:55.569465 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-114.ec2.internal" podStartSLOduration=3.56944131 podStartE2EDuration="3.56944131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:54.53730343 +0000 UTC m=+6.119175946" watchObservedRunningTime="2026-07-08 16:03:55.56944131 +0000 UTC m=+7.151313826" Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.041041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.041127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.041269 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.041339 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:00.041319294 +0000 UTC m=+11.623191802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.041755 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:56.041856 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.041805 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:00.041789066 +0000 UTC m=+11.623661575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:03:56.142949 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.142214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:56.142949 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.142420 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:03:56.142949 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.142442 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:03:56.142949 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.142458 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:56.142949 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.142523 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:00.142503776 +0000 UTC m=+11.724376270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.476288 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.476507 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.477082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.477247 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.477403 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:56.480867 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:56.477526 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:03:56.556228 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.556186 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" event={"ID":"be705dfd14987f99ad404ea217ebfdbd","Type":"ContainerStarted","Data":"46fc52fa151de3bbc746218a8891d44217fc92bacff89003c219c2a872b6be4d"} Jul 08 16:03:56.575925 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:56.575856 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-114.ec2.internal" podStartSLOduration=4.5758336360000005 podStartE2EDuration="4.575833636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:56.574887218 +0000 UTC m=+8.156759734" watchObservedRunningTime="2026-07-08 16:03:56.575833636 +0000 UTC m=+8.157706155" Jul 08 16:03:58.465471 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:58.465442 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:03:58.465937 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:58.465574 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:03:58.466017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:58.465946 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:03:58.466085 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:58.466050 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:03:58.466150 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:03:58.466132 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:03:58.466266 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:03:58.466242 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:00.074387 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.074147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:00.074387 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.074207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:00.074387 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.074350 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:00.074964 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.074429 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:08.074408704 +0000 UTC m=+19.656281198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:00.074964 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.074361 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:00.074964 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.074584 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:08.074567737 +0000 UTC m=+19.656440241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:00.175304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.175207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:00.175481 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.175405 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:04:00.175481 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.175433 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:04:00.175481 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.175452 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:00.175634 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.175519 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:08.175500126 +0000 UTC m=+19.757372635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.466427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.466549 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.466919 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.467020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:00.467092 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:00.467247 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:00.467164 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:02.465308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:02.465272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:02.465766 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:02.465321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:02.465766 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:02.465418 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:02.465766 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:02.465559 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:02.465766 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:02.465637 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:02.465766 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:02.465713 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:04.465791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.465620 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:04.465791 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:04.465758 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:04.466411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.465861 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:04.466411 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:04.465992 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:04.466411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.466072 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:04.466411 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:04.466149 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:04.575240 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.574850 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvtw4" event={"ID":"1b3dea69-0b99-490d-a1cd-e70276215f9e","Type":"ContainerStarted","Data":"9c5dd160160a9083fb777350ce9646f9047cfc30e63fc7a29a5c9483733c8416"} Jul 08 16:04:04.577952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.577514 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fr229" event={"ID":"742d552f-053e-4b3c-8cca-7c961b8e60a1","Type":"ContainerStarted","Data":"12da87335821859e5f4c45277c5d79043dbc0e3521da8db8cf90935f8d01b868"} Jul 08 16:04:04.579901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.579865 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vbnm" event={"ID":"7205266f-f9b5-427e-ac93-5545dc478fa7","Type":"ContainerStarted","Data":"bb3a99affbfbf664e07b58c4d95366a1caf63af7d303d702de651dcdf2af5b54"} Jul 08 16:04:04.582486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.582456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" event={"ID":"ebc67e7f-38bc-4641-ac27-36cdc9074e2f","Type":"ContainerStarted","Data":"87b4cf181a0ec0e33f308021e09fbd3f0d150a1c294c049e34d6dfc700766ae5"} Jul 08 16:04:04.584399 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.584374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" event={"ID":"339909d4-d91c-43ff-a2d2-2297a3d2e0f7","Type":"ContainerStarted","Data":"9d30ff3576f90ee8884d0d8d3e449500ba4910ffc5b2a07bd8632346014dbe36"} Jul 08 16:04:04.587657 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.587629 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="ddd88808cb0a29e8685d4ccd2af442d405a13223fda7336368d6b3b52e4eeec7" exitCode=0 Jul 08 16:04:04.587762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.587670 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"ddd88808cb0a29e8685d4ccd2af442d405a13223fda7336368d6b3b52e4eeec7"} Jul 08 16:04:04.612861 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.612803 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fr229" podStartSLOduration=2.589424941 podStartE2EDuration="13.612782516s" totalImagesPullingTime="11.023357575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:04.612302202 +0000 UTC m=+16.194174716" watchObservedRunningTime="2026-07-08 16:04:04.612782516 +0000 UTC m=+16.194655028" Jul 08 16:04:04.613487 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.613450 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvtw4" podStartSLOduration=2.583089311 podStartE2EDuration="13.613438977s" totalImagesPullingTime="11.030349666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:04.592716873 +0000 UTC m=+16.174589384" watchObservedRunningTime="2026-07-08 16:04:04.613438977 +0000 UTC m=+16.195311489" Jul 08 16:04:04.660926 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.660710 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6gjnr" podStartSLOduration=2.561139623 podStartE2EDuration="13.660688419s" totalImagesPullingTime="11.099548796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:04.660232603 +0000 UTC m=+16.242105114" watchObservedRunningTime="2026-07-08 16:04:04.660688419 +0000 UTC m=+16.242560930" Jul 08 16:04:04.678335 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.677866 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6vbnm" podStartSLOduration=2.638208714 podStartE2EDuration="13.677844178s" totalImagesPullingTime="11.039635464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:04.677260177 +0000 UTC m=+16.259132689" watchObservedRunningTime="2026-07-08 16:04:04.677844178 +0000 UTC m=+16.259716692" Jul 08 16:04:04.681545 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.681514 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:04:04.682162 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:04.682144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:04:05.147163 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.147125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:05.229499 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.229456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:05.329982 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.329870 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:05.591984 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.591880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2htp" event={"ID":"af65c777-0efd-4b1c-9ac8-e2f848bc11d4","Type":"ContainerStarted","Data":"dd544889bfe05748cf3d0eeca0caa9554dd999e7be97f53d5f981c4e3b51f671"} Jul 08 16:04:05.592711 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.592663 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:04:05.593169 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.593151 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fr229" Jul 08 16:04:05.628451 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:05.628369 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b2htp" podStartSLOduration=3.588534958 podStartE2EDuration="14.628347346s" totalImagesPullingTime="11.039812388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:05.610403103 +0000 UTC m=+17.192275614" watchObservedRunningTime="2026-07-08 16:04:05.628347346 +0000 UTC m=+17.210219857" Jul 08 16:04:06.032489 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.032404 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:06.149249 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.149211 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:06.439639 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.439549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:06.465545 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.465496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:06.465734 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.465496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:06.465734 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:06.465621 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:06.465837 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:06.465726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:06.465837 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.465496 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:06.465837 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:06.465820 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:06.554284 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.554243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:06.644979 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:06.644753 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:07.723046 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:07.722999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vbnm_7205266f-f9b5-427e-ac93-5545dc478fa7/dns-node-resolver/0.log" Jul 08 16:04:08.138518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.138440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:08.138518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.138484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:08.138761 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.138602 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:08.138761 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.138683 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:24.138666685 +0000 UTC m=+35.720539190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:08.138761 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.138606 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:08.138875 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.138780 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:24.138759656 +0000 UTC m=+35.720632160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:08.239813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.239766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:08.239997 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.239918 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:04:08.239997 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.239944 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:04:08.239997 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.239959 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:08.240178 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.240022 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:24.240002327 +0000 UTC m=+35.821874816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:08.295063 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.294984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:08.395550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.395439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:08.464757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.464727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:08.464929 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.464770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:08.464929 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.464727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:08.464929 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.464873 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:08.465106 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.464944 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:08.465106 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:08.465023 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:08.747062 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.746956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:08.926391 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:08.926359 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvtw4_1b3dea69-0b99-490d-a1cd-e70276215f9e/node-ca/0.log" Jul 08 16:04:09.325871 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:09.325835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:09.969330 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:09.969301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:10.150609 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.150552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:10.251767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.251650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:10.337382 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.337339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:10.466643 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.466610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:10.466793 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:10.466735 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:10.467195 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.467116 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:10.467312 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:10.467248 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:10.467312 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.467259 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:10.467426 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:10.467332 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:10.477775 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.477743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:10.660715 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:10.660624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:11.265297 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:11.265261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:11.672256 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:11.672101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:11.744051 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:11.743984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:12.065451 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.065366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:12.166301 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.166258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:12.267464 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.267426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:12.464658 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.464561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:12.464852 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.464710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:12.464852 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:12.464821 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:12.465108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.465082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:12.465242 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:12.465189 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:12.465242 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.465239 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:12.465369 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:12.465316 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:12.672463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:12.672407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:13.064638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.064597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:13.374194 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.373941 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 16:04:13.463052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.462991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:13.610840 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.610753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" event={"ID":"ebc67e7f-38bc-4641-ac27-36cdc9074e2f","Type":"ContainerStarted","Data":"e060196742014ef09e3850e647a11ecc40bc189427ff5b869b52d5270619d25a"} Jul 08 16:04:13.612815 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.612785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"503e848fb2cf245bfd4ef1679919533c07423c33f1ef2236e52d02cd13fe3936"} Jul 08 16:04:13.612936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.612861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"cb1ffc57b958258792ad2b7c469a85bef8b61b3342edb2e26a7ec334de46d746"} Jul 08 16:04:13.614375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.614345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7t2kp" event={"ID":"086077ba-ff82-4f8c-8fb9-a06fbc99a8d4","Type":"ContainerStarted","Data":"3fb4c600b4d4847d3807a969eef303c69f69ffcbe54ea7d27051234718f12000"} Jul 08 16:04:13.637253 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.637199 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7t2kp" podStartSLOduration=2.013250486 podStartE2EDuration="22.637183285s" totalImagesPullingTime="20.623932799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:13.636581106 +0000 UTC m=+25.218453615" watchObservedRunningTime="2026-07-08 16:04:13.637183285 +0000 UTC m=+25.219055799" Jul 08 16:04:13.926516 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:13.926408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:14.298571 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.298476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:14.367369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.367322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:14.370926 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.370832 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:04:13.374184295Z","UUID":"19895b2a-3de3-4900-8ff9-fdc45321d566","Handler":null,"Name":"","Endpoint":""} Jul 08 16:04:14.372864 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.372837 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 16:04:14.372985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.372881 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 16:04:14.465331 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.465295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:14.465851 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.465297 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:14.465851 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.465431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:14.465851 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:14.465434 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:14.465851 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:14.465527 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:14.465851 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:14.465645 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:14.521507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:14.521458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:15.573452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.573264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:15.624589 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.624523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:04:15.624868 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.624845 2572 generic.go:356] "Generic (PLEG): container finished" podID="f543f4a7-9a15-47dd-9a96-b175d023857d" containerID="503e848fb2cf245bfd4ef1679919533c07423c33f1ef2236e52d02cd13fe3936" exitCode=1 Jul 08 16:04:15.624932 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.624913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerDied","Data":"503e848fb2cf245bfd4ef1679919533c07423c33f1ef2236e52d02cd13fe3936"} Jul 08 16:04:15.625028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.625016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"34ec4f6a6b8022aa3253750f6b8bc3f292cd7978da45fa0b98c125ff63528636"} Jul 08 16:04:15.625083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.625071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"6e5c07986dece21e354c335345fafdec7e917fd903029fe52b5a6a890e67831c"} Jul 08 16:04:15.625113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.625107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"ad5b58c1054feb6b76b91b599b3b3d2c71eaa1b23f96412f9acdf80a87e0c8e2"} Jul 08 16:04:15.625167 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.625140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"5fd0b7dc2b7e9ffb8177aa7f151211e8b89d94186fe4eb2cedc4692d52c70082"} Jul 08 16:04:15.626635 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.626607 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="0d64d8e95ba3c2b340135c52a1c3f1061163d4e6bdc70a666c9efb43725fe4ee" exitCode=0 Jul 08 16:04:15.626728 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.626641 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"0d64d8e95ba3c2b340135c52a1c3f1061163d4e6bdc70a666c9efb43725fe4ee"} Jul 08 16:04:15.654099 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.654060 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:15.863659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.863579 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:15.994685 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:15.994655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:16.096382 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.096353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:16.197017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.196934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:16.465184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.465101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:16.465318 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.465101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:16.465318 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:16.465209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:16.465318 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.465102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:16.465318 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:16.465285 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:16.465442 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:16.465371 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:16.631277 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.631238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" event={"ID":"ebc67e7f-38bc-4641-ac27-36cdc9074e2f","Type":"ContainerStarted","Data":"f3376f5727497b7b9195e58f7d690aaa65befa6f2d13b99b72526225d7690c46"} Jul 08 16:04:16.652516 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.652465 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2g8cs" podStartSLOduration=2.745548108 podStartE2EDuration="25.652449755s" totalImagesPullingTime="22.906901647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:16.652054332 +0000 UTC m=+28.233926852" watchObservedRunningTime="2026-07-08 16:04:16.652449755 +0000 UTC m=+28.234322266" Jul 08 16:04:16.676522 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:16.676484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:17.103253 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:17.103214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:17.494444 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:17.494351 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:17.635790 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:17.635757 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="5922f767a1437d7fc24ea7a8a8f4c33983661ebf8d8bb5773626643d3ecfe154" exitCode=0 Jul 08 16:04:17.636269 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:17.635845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"5922f767a1437d7fc24ea7a8a8f4c33983661ebf8d8bb5773626643d3ecfe154"} Jul 08 16:04:17.867270 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:17.867183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:18.060351 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.060310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:18.465021 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.464990 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:18.465211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.464989 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:18.465211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.464989 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:18.465211 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:18.465134 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:18.465211 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:18.465196 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:18.465413 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:18.465287 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:18.641377 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.641349 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:04:18.641866 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.641671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"8ca92568edea208d87df8f531f5dac8bb110d609ae1cd0603dfae22d250f5c6d"} Jul 08 16:04:18.663174 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:18.663143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:19.066260 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:19.066174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:19.301331 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:19.301290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:19.645807 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:19.645778 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="a72058e9a1d5f7f4b07ffd7c2d08dff4d80903f1f31c1971cb0c236e5d839027" exitCode=0 Jul 08 16:04:19.646228 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:19.645815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"a72058e9a1d5f7f4b07ffd7c2d08dff4d80903f1f31c1971cb0c236e5d839027"} Jul 08 16:04:19.659726 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:19.659699 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:20.074981 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.074799 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:20.463997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.463961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:20.465587 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.465561 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:20.465690 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:20.465639 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:20.465744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.465719 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:20.465824 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:20.465808 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:20.465863 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.465846 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:20.465930 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:20.465917 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:20.651578 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.651551 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:04:20.652290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.651849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"dc20a7e9775869448ab66608704795116afffff2f4fa72c0b807f5666bfe248b"} Jul 08 16:04:20.652290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.652132 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:20.652388 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.652336 2572 scope.go:117] "RemoveContainer" containerID="503e848fb2cf245bfd4ef1679919533c07423c33f1ef2236e52d02cd13fe3936" Jul 08 16:04:20.670532 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.670498 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:20.689246 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:20.689218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:21.658597 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.658569 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:04:21.659006 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.658926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" event={"ID":"f543f4a7-9a15-47dd-9a96-b175d023857d","Type":"ContainerStarted","Data":"8de0df09bd7e77eec5ea58ade4651da5e5edc369b1e5089b81b74177adbf20e5"} Jul 08 16:04:21.659303 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.659282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:21.659454 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.659440 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:21.677286 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.677249 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:21.692507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:21.692461 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" podStartSLOduration=10.075042292 podStartE2EDuration="30.692446766s" totalImagesPullingTime="20.617404474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:21.691134908 +0000 UTC m=+33.273007422" watchObservedRunningTime="2026-07-08 16:04:21.692446766 +0000 UTC m=+33.274319277" Jul 08 16:04:22.465639 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:22.465602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:22.465824 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:22.465602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:22.465824 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:22.465728 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:22.465824 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:22.465746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:22.465995 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:22.465865 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:22.465995 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:22.465936 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:24.164313 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.164269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:24.164864 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.164331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:24.164864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.164447 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:24.164864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.164453 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:24.164864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.164516 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret podName:74a247e1-67ea-48e8-a307-77250c689099 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:56.164497855 +0000 UTC m=+67.746370367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret") pod "global-pull-secret-syncer-wtqbv" (UID: "74a247e1-67ea-48e8-a307-77250c689099") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:04:24.164864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.164537 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs podName:e5f2c980-d091-4f8a-9d1b-02a65eee3884 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:56.16452742 +0000 UTC m=+67.746399916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs") pod "network-metrics-daemon-xqx9p" (UID: "e5f2c980-d091-4f8a-9d1b-02a65eee3884") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:04:24.265748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.265713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:24.265925 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.265848 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:04:24.265925 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.265869 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:04:24.265925 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.265884 2572 projected.go:196] Error preparing data for projected volume kube-api-access-q9jq8 for pod openshift-network-diagnostics/network-check-target-ppbqf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:24.266072 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.265943 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8 podName:17b392ab-3a13-4bed-b38f-96a46c306345 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:56.265925821 +0000 UTC m=+67.847798310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q9jq8" (UniqueName: "kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8") pod "network-check-target-ppbqf" (UID: "17b392ab-3a13-4bed-b38f-96a46c306345") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:04:24.465627 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.465532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:24.465627 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.465575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:24.465849 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.465657 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:24.465849 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:24.465530 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:24.465849 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.465766 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:24.466003 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:24.465865 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:26.464975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:26.464938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:26.464975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:26.464969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:26.465465 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:26.464938 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:26.465465 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:26.465063 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:26.465646 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:26.465616 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:26.466742 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:26.466702 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:26.674161 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:26.674124 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="472ac0ba92b94dd3d92300aa005a791403a2789531519ee923b8d4d0fcace9aa" exitCode=0 Jul 08 16:04:26.674161 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:26.674165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"472ac0ba92b94dd3d92300aa005a791403a2789531519ee923b8d4d0fcace9aa"} Jul 08 16:04:27.216554 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.216461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:27.334005 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.333978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:27.448471 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.448439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:27.550150 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.550053 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:27.648159 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.648122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:27.679409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.679379 2572 generic.go:356] "Generic (PLEG): container finished" podID="72823315-3130-4009-ac3d-e3b1eadd8e84" containerID="ce26bcbac226223b81946a1119ac7530009110f667a2ffb6d8602c9090a3196e" exitCode=0 Jul 08 16:04:27.679566 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.679440 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerDied","Data":"ce26bcbac226223b81946a1119ac7530009110f667a2ffb6d8602c9090a3196e"} Jul 08 16:04:27.730869 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:27.730833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:28.465364 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.465336 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:28.465531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.465425 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:28.465602 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:28.465546 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:28.465864 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.465377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:28.465864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:28.465735 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:28.465864 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:28.465826 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:28.686245 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.686215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" event={"ID":"72823315-3130-4009-ac3d-e3b1eadd8e84","Type":"ContainerStarted","Data":"4f2dc5186fda04086ef9244f80b2278aa095f0f0bbee6f0647bc3edf8c91e619"} Jul 08 16:04:28.716057 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.715889 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k8vlz" podStartSLOduration=7.225785844 podStartE2EDuration="37.715865036s" totalImagesPullingTime="30.490079192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:28.715056372 +0000 UTC m=+40.296928881" watchObservedRunningTime="2026-07-08 16:04:28.715865036 +0000 UTC m=+40.297737549" Jul 08 16:04:28.842238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.842203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:28.942509 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:28.942328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:29.084713 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.084634 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xqx9p"] Jul 08 16:04:29.084841 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.084773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:29.084879 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:29.084858 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:29.085231 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.085211 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wtqbv"] Jul 08 16:04:29.085303 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.085292 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:29.085375 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:29.085360 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:29.098631 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.098594 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ppbqf"] Jul 08 16:04:29.098799 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:29.098742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:29.098869 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:29.098844 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:30.389878 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.389787 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:30.466571 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.466532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:30.466748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.466640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:30.466748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.466673 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:30.466748 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:30.466674 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:30.466867 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:30.466748 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:30.466867 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:30.466832 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:30.484986 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.484954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:30.548291 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.548230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:30.674691 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.674599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:30.849015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.848989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:30.928074 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:30.927972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:31.248969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:31.248877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:31.348100 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:31.348026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:31.503464 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:31.503374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:31.856586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:31.856512 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:32.265578 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.265486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:32.464071 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.464013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:32.464791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.464778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:32.464853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.464787 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:32.464900 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:32.464889 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ppbqf" podUID="17b392ab-3a13-4bed-b38f-96a46c306345" Jul 08 16:04:32.464978 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:32.464948 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xqx9p" podUID="e5f2c980-d091-4f8a-9d1b-02a65eee3884" Jul 08 16:04:32.465075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.465056 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:32.465194 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:32.465176 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wtqbv" podUID="74a247e1-67ea-48e8-a307-77250c689099" Jul 08 16:04:32.528600 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:32.528482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:33.249907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.249881 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-114.ec2.internal" event="NodeReady" Jul 08 16:04:33.250121 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.249996 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 16:04:33.297681 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.297652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:33.302346 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.302322 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wwrrt"] Jul 08 16:04:33.320433 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.319868 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m4v84"] Jul 08 16:04:33.320715 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.320555 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.323409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.323386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 16:04:33.323537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.323424 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 16:04:33.323730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.323713 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xz56b\"" Jul 08 16:04:33.346023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.345994 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wwrrt"] Jul 08 16:04:33.346178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.346053 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4v84"] Jul 08 16:04:33.346178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.346086 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xrs2h"] Jul 08 16:04:33.346178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.346142 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.349293 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.349134 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 16:04:33.349628 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.349609 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 16:04:33.349732 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.349628 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 16:04:33.349732 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.349700 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 16:04:33.349907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.349890 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2pd8l\"" Jul 08 16:04:33.370075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.370021 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xrs2h"] Jul 08 16:04:33.370209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.370140 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.372901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.372870 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 16:04:33.373053 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.372937 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 16:04:33.373208 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.373188 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 16:04:33.373751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.373735 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zdhd9\"" Jul 08 16:04:33.384590 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.384566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:33.433654 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56237a07-3740-4e3f-86b3-79cc00a4ac2e-crio-socket\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.433654 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5flqh\" (UniqueName: \"kubernetes.io/projected/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-api-access-5flqh\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cffcd9-ca81-425f-ab92-e33ca7b7250b-tmp-dir\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93cffcd9-ca81-425f-ab92-e33ca7b7250b-metrics-tls\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56237a07-3740-4e3f-86b3-79cc00a4ac2e-data-volume\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93cffcd9-ca81-425f-ab92-e33ca7b7250b-config-volume\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.433902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56237a07-3740-4e3f-86b3-79cc00a4ac2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.434149 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.433923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nm66\" (UniqueName: \"kubernetes.io/projected/93cffcd9-ca81-425f-ab92-e33ca7b7250b-kube-api-access-4nm66\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.474276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.474242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:33.535294 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef20300-0f27-48c0-b335-39fe6346461e-cert\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.535294 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56237a07-3740-4e3f-86b3-79cc00a4ac2e-data-volume\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93cffcd9-ca81-425f-ab92-e33ca7b7250b-config-volume\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535396 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56237a07-3740-4e3f-86b3-79cc00a4ac2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxf7s\" (UniqueName: \"kubernetes.io/projected/2ef20300-0f27-48c0-b335-39fe6346461e-kube-api-access-qxf7s\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nm66\" (UniqueName: \"kubernetes.io/projected/93cffcd9-ca81-425f-ab92-e33ca7b7250b-kube-api-access-4nm66\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56237a07-3740-4e3f-86b3-79cc00a4ac2e-crio-socket\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5flqh\" (UniqueName: \"kubernetes.io/projected/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-api-access-5flqh\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cffcd9-ca81-425f-ab92-e33ca7b7250b-tmp-dir\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93cffcd9-ca81-425f-ab92-e33ca7b7250b-metrics-tls\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56237a07-3740-4e3f-86b3-79cc00a4ac2e-data-volume\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.535909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.535695 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56237a07-3740-4e3f-86b3-79cc00a4ac2e-crio-socket\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.536507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.536469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93cffcd9-ca81-425f-ab92-e33ca7b7250b-tmp-dir\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.536593 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.536572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93cffcd9-ca81-425f-ab92-e33ca7b7250b-config-volume\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.536655 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.536601 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.541050 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.541012 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56237a07-3740-4e3f-86b3-79cc00a4ac2e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.541254 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.541233 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93cffcd9-ca81-425f-ab92-e33ca7b7250b-metrics-tls\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.544237 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.544215 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nm66\" (UniqueName: \"kubernetes.io/projected/93cffcd9-ca81-425f-ab92-e33ca7b7250b-kube-api-access-4nm66\") pod \"dns-default-wwrrt\" (UID: \"93cffcd9-ca81-425f-ab92-e33ca7b7250b\") " pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.544546 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.544529 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5flqh\" (UniqueName: \"kubernetes.io/projected/56237a07-3740-4e3f-86b3-79cc00a4ac2e-kube-api-access-5flqh\") pod \"insights-runtime-extractor-m4v84\" (UID: \"56237a07-3740-4e3f-86b3-79cc00a4ac2e\") " pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.578215 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.578183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:33.630004 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.629971 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:33.636256 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.636220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef20300-0f27-48c0-b335-39fe6346461e-cert\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.636394 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.636306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxf7s\" (UniqueName: \"kubernetes.io/projected/2ef20300-0f27-48c0-b335-39fe6346461e-kube-api-access-qxf7s\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.638583 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.638564 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef20300-0f27-48c0-b335-39fe6346461e-cert\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.644889 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.644867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxf7s\" (UniqueName: \"kubernetes.io/projected/2ef20300-0f27-48c0-b335-39fe6346461e-kube-api-access-qxf7s\") pod \"ingress-canary-xrs2h\" (UID: \"2ef20300-0f27-48c0-b335-39fe6346461e\") " pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.655771 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.655746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m4v84" Jul 08 16:04:33.678521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.678497 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xrs2h" Jul 08 16:04:33.871873 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.871671 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wwrrt"] Jul 08 16:04:33.872658 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.872617 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m4v84"] Jul 08 16:04:33.874759 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:33.874731 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56237a07_3740_4e3f_86b3_79cc00a4ac2e.slice/crio-1bd3bc851f946b9e2bc1e80c886e1aab27af9a19e007d3e2e1cd95444163f748 WatchSource:0}: Error finding container 1bd3bc851f946b9e2bc1e80c886e1aab27af9a19e007d3e2e1cd95444163f748: Status 404 returned error can't find the container with id 1bd3bc851f946b9e2bc1e80c886e1aab27af9a19e007d3e2e1cd95444163f748 Jul 08 16:04:33.875395 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:33.875377 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cffcd9_ca81_425f_ab92_e33ca7b7250b.slice/crio-95ad6108de8b274b70746f647ad4ca6969df7c530c5568ed271a1de5a3c9aa02 WatchSource:0}: Error finding container 95ad6108de8b274b70746f647ad4ca6969df7c530c5568ed271a1de5a3c9aa02: Status 404 returned error can't find the container with id 95ad6108de8b274b70746f647ad4ca6969df7c530c5568ed271a1de5a3c9aa02 Jul 08 16:04:33.881331 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.881297 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xrs2h"] Jul 08 16:04:33.885321 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:33.885298 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef20300_0f27_48c0_b335_39fe6346461e.slice/crio-92ef62e3bd1fb98e68040123a41ac94ed74481e19864abc3bdcff541a683232d WatchSource:0}: Error finding container 92ef62e3bd1fb98e68040123a41ac94ed74481e19864abc3bdcff541a683232d: Status 404 returned error can't find the container with id 92ef62e3bd1fb98e68040123a41ac94ed74481e19864abc3bdcff541a683232d Jul 08 16:04:33.954802 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:33.954769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:34.055335 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.055299 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:34.135214 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.135125 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w"] Jul 08 16:04:34.140538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.140506 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:34.161493 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.161457 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w"] Jul 08 16:04:34.161629 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.161554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:34.166133 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.166097 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 16:04:34.166271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.166160 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qjqv5\"" Jul 08 16:04:34.342423 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.342385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95e6b389-b312-46dc-b5f3-3b78f30c9f9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c6q8w\" (UID: \"95e6b389-b312-46dc-b5f3-3b78f30c9f9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:34.442321 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.442289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:34.443074 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.443052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95e6b389-b312-46dc-b5f3-3b78f30c9f9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c6q8w\" (UID: \"95e6b389-b312-46dc-b5f3-3b78f30c9f9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:34.446220 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.446198 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95e6b389-b312-46dc-b5f3-3b78f30c9f9f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-c6q8w\" (UID: \"95e6b389-b312-46dc-b5f3-3b78f30c9f9f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:34.464903 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.464869 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:34.465056 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.464877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:34.465056 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.464996 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:34.468310 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.468284 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:04:34.468446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.468315 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:04:34.468446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.468350 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pr5b4\"" Jul 08 16:04:34.468546 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.468460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:04:34.468744 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.468724 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:04:34.469276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.469262 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wzt7p\"" Jul 08 16:04:34.470657 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.470630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:34.642085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.641989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w"] Jul 08 16:04:34.646380 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:34.646348 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e6b389_b312_46dc_b5f3_3b78f30c9f9f.slice/crio-b975c89634355c1f82bb2201626a780b0a04d5ced3d922e70f5abcadbf6a472a WatchSource:0}: Error finding container b975c89634355c1f82bb2201626a780b0a04d5ced3d922e70f5abcadbf6a472a: Status 404 returned error can't find the container with id b975c89634355c1f82bb2201626a780b0a04d5ced3d922e70f5abcadbf6a472a Jul 08 16:04:34.650721 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.650660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:34.705379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.705298 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" event={"ID":"95e6b389-b312-46dc-b5f3-3b78f30c9f9f","Type":"ContainerStarted","Data":"b975c89634355c1f82bb2201626a780b0a04d5ced3d922e70f5abcadbf6a472a"} Jul 08 16:04:34.707698 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.707666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4v84" event={"ID":"56237a07-3740-4e3f-86b3-79cc00a4ac2e","Type":"ContainerStarted","Data":"1bd3bc851f946b9e2bc1e80c886e1aab27af9a19e007d3e2e1cd95444163f748"} Jul 08 16:04:34.709458 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.709400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xrs2h" event={"ID":"2ef20300-0f27-48c0-b335-39fe6346461e","Type":"ContainerStarted","Data":"92ef62e3bd1fb98e68040123a41ac94ed74481e19864abc3bdcff541a683232d"} Jul 08 16:04:34.710993 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.710939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwrrt" event={"ID":"93cffcd9-ca81-425f-ab92-e33ca7b7250b","Type":"ContainerStarted","Data":"95ad6108de8b274b70746f647ad4ca6969df7c530c5568ed271a1de5a3c9aa02"} Jul 08 16:04:34.721520 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:34.721476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:35.566138 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:35.566023 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:35.666507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:35.666471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:35.958136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:35.958097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:36.060380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:36.060339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:37.852401 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:37.852352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:37.942698 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:37.942653 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:40.295362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.295324 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:04:40.309113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.309065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:04:40.309288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.309200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.312459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.312267 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 16:04:40.312459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.312283 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 16:04:40.312459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.312309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 16:04:40.312459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.312346 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 16:04:40.312459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.312267 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 16:04:40.313573 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.313543 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 16:04:40.313726 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.313577 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 16:04:40.313885 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.313870 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t6zzf\"" Jul 08 16:04:40.489184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489141 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.489184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrwks\" (UniqueName: \"kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.489394 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.489394 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.489394 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.489394 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.489386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrwks\" (UniqueName: \"kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.590917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.590915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.591738 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.591716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.591886 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.591716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.591961 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.591876 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.594449 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.594424 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.594528 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.594479 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.602258 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.602199 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrwks\" (UniqueName: \"kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks\") pod \"console-745647bf97-ws7vc\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.620866 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.620798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:40.731508 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.731456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" event={"ID":"95e6b389-b312-46dc-b5f3-3b78f30c9f9f","Type":"ContainerStarted","Data":"9a7a36eea2de251c6d432fcfd96ef9d5e7d12f9ee79a26fbd2b7aecd3290aab8"} Jul 08 16:04:40.733024 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.732985 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xrs2h" event={"ID":"2ef20300-0f27-48c0-b335-39fe6346461e","Type":"ContainerStarted","Data":"2567f364b6c744cfeb6f3118469644c30a11116fcac960138e694002cc5d7350"} Jul 08 16:04:40.734587 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.734556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwrrt" event={"ID":"93cffcd9-ca81-425f-ab92-e33ca7b7250b","Type":"ContainerStarted","Data":"98a5e983d4961a26e14df9b666f98058e36c555084e4b75ab42c3023f613541b"} Jul 08 16:04:40.740436 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.740392 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:40.742901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.742583 2572 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-d559d66d5-c6q8w container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.9:8443/healthz\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jul 08 16:04:40.742901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.742640 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" podUID="95e6b389-b312-46dc-b5f3-3b78f30c9f9f" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.133.0.9:8443/healthz\": dial tcp 10.133.0.9:8443: connect: connection refused" Jul 08 16:04:40.757463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.757400 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" podStartSLOduration=0.868544803 podStartE2EDuration="6.757380378s" totalImagesPullingTime="5.888835575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:40.756828967 +0000 UTC m=+52.338701474" watchObservedRunningTime="2026-07-08 16:04:40.757380378 +0000 UTC m=+52.339252890" Jul 08 16:04:40.778575 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.778523 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xrs2h" podStartSLOduration=1.106118441 podStartE2EDuration="7.778508016s" totalImagesPullingTime="6.672389575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:40.777132781 +0000 UTC m=+52.359005315" watchObservedRunningTime="2026-07-08 16:04:40.778508016 +0000 UTC m=+52.360380527" Jul 08 16:04:40.798096 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:40.798065 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:04:40.880338 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:40.880304 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f49ed36_b3e0_4710_ac55_d9d8eddb9ad7.slice/crio-b2457f710125bfaaf3f73ceb647db283049b354dc4cd7d8be7c5b397848a6472 WatchSource:0}: Error finding container b2457f710125bfaaf3f73ceb647db283049b354dc4cd7d8be7c5b397848a6472: Status 404 returned error can't find the container with id b2457f710125bfaaf3f73ceb647db283049b354dc4cd7d8be7c5b397848a6472 Jul 08 16:04:41.739016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:41.738974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745647bf97-ws7vc" event={"ID":"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7","Type":"ContainerStarted","Data":"b2457f710125bfaaf3f73ceb647db283049b354dc4cd7d8be7c5b397848a6472"} Jul 08 16:04:41.740545 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:41.740516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4v84" event={"ID":"56237a07-3740-4e3f-86b3-79cc00a4ac2e","Type":"ContainerStarted","Data":"e0657fb2abcbfbf561877c5587d03db5c90afd0f14b2c77ae96084197fff03e4"} Jul 08 16:04:41.742206 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:41.742183 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwrrt" event={"ID":"93cffcd9-ca81-425f-ab92-e33ca7b7250b","Type":"ContainerStarted","Data":"02ac112bae21b020a0d5518ccfdc8914e4f7b2e71d075a3919ce6bca95dc3bf4"} Jul 08 16:04:41.746204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:41.746153 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-c6q8w" Jul 08 16:04:41.765238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:41.765188 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wwrrt" podStartSLOduration=2.111686118 podStartE2EDuration="8.765171182s" totalImagesPullingTime="6.653485064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:41.764709828 +0000 UTC m=+53.346582339" watchObservedRunningTime="2026-07-08 16:04:41.765171182 +0000 UTC m=+53.347043671" Jul 08 16:04:42.149083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.148978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.211638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.211607 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p"] Jul 08 16:04:42.230224 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.230183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.231064 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.231027 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p"] Jul 08 16:04:42.231151 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.231135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.234092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.234065 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 16:04:42.234092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.234085 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 16:04:42.234273 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.234103 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 16:04:42.234273 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.234172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8tsvf\"" Jul 08 16:04:42.235270 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.235252 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 16:04:42.235270 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.235261 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 16:04:42.404354 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.404259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e6c73b-0f70-412d-99dc-aff4c73935d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.404354 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.404325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.404577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.404421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.404577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.404458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffmvq\" (UniqueName: \"kubernetes.io/projected/a8e6c73b-0f70-412d-99dc-aff4c73935d6-kube-api-access-ffmvq\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.436426 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.436389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.505894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.505857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e6c73b-0f70-412d-99dc-aff4c73935d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.506088 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.505923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.506088 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.505958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.506088 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.505977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffmvq\" (UniqueName: \"kubernetes.io/projected/a8e6c73b-0f70-412d-99dc-aff4c73935d6-kube-api-access-ffmvq\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.506546 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.506523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e6c73b-0f70-412d-99dc-aff4c73935d6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.508327 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.508304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.508410 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.508381 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a8e6c73b-0f70-412d-99dc-aff4c73935d6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.515518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.515490 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffmvq\" (UniqueName: \"kubernetes.io/projected/a8e6c73b-0f70-412d-99dc-aff4c73935d6-kube-api-access-ffmvq\") pod \"prometheus-operator-567f7b8b7c-xqz2p\" (UID: \"a8e6c73b-0f70-412d-99dc-aff4c73935d6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.540354 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.540320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" Jul 08 16:04:42.761652 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.761598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:42.845455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:42.845423 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p"] Jul 08 16:04:42.848449 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:42.848422 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e6c73b_0f70_412d_99dc_aff4c73935d6.slice/crio-87e491dbb8bb9009076cdbed978c4a78f144e655268616df07b3f35b5fb88e7d WatchSource:0}: Error finding container 87e491dbb8bb9009076cdbed978c4a78f144e655268616df07b3f35b5fb88e7d: Status 404 returned error can't find the container with id 87e491dbb8bb9009076cdbed978c4a78f144e655268616df07b3f35b5fb88e7d Jul 08 16:04:43.752159 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:43.752116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4v84" event={"ID":"56237a07-3740-4e3f-86b3-79cc00a4ac2e","Type":"ContainerStarted","Data":"12d575faf6a4014cb0b20e3bf2b44977d2200d9ec7e00cc6fb7c1c7f29742520"} Jul 08 16:04:43.753787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:43.753753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" event={"ID":"a8e6c73b-0f70-412d-99dc-aff4c73935d6","Type":"ContainerStarted","Data":"87e491dbb8bb9009076cdbed978c4a78f144e655268616df07b3f35b5fb88e7d"} Jul 08 16:04:45.279608 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:45.279574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:47.409555 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.409467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:47.770282 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.770244 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745647bf97-ws7vc" event={"ID":"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7","Type":"ContainerStarted","Data":"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3"} Jul 08 16:04:47.772309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.772278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m4v84" event={"ID":"56237a07-3740-4e3f-86b3-79cc00a4ac2e","Type":"ContainerStarted","Data":"f5591401b8cf633948a2dd0fa9c3884d97ce9944393762a864e2cf5a85b68955"} Jul 08 16:04:47.773844 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.773820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" event={"ID":"a8e6c73b-0f70-412d-99dc-aff4c73935d6","Type":"ContainerStarted","Data":"bf470c5f9acdcb6854f18670ad0e2d84d9fe2caac9866c8ea945e86dea0463b9"} Jul 08 16:04:47.773957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.773860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" event={"ID":"a8e6c73b-0f70-412d-99dc-aff4c73935d6","Type":"ContainerStarted","Data":"0e0fd626719c0ee6edfb9adcd8a73c02f6f357df3fb0a6a1cb47b521170c6970"} Jul 08 16:04:47.793342 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.793284 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745647bf97-ws7vc" podStartSLOduration=1.570226017 podStartE2EDuration="7.793269023s" totalImagesPullingTime="6.223043006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:47.791860446 +0000 UTC m=+59.373732958" watchObservedRunningTime="2026-07-08 16:04:47.793269023 +0000 UTC m=+59.375141533" Jul 08 16:04:47.833646 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.833595 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m4v84" podStartSLOduration=1.832548412 podStartE2EDuration="14.833577764s" totalImagesPullingTime="13.001029352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:04:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:47.815326409 +0000 UTC m=+59.397198918" watchObservedRunningTime="2026-07-08 16:04:47.833577764 +0000 UTC m=+59.415450274" Jul 08 16:04:47.833891 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:47.833873 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqz2p" podStartSLOduration=1.5671925500000001 podStartE2EDuration="5.833867087s" totalImagesPullingTime="4.266674537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:47.832955815 +0000 UTC m=+59.414828352" watchObservedRunningTime="2026-07-08 16:04:47.833867087 +0000 UTC m=+59.415739597" Jul 08 16:04:48.583333 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.583304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:48.684487 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.684456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:48.871219 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.871131 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:04:48.873435 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.873412 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.891706 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.891678 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 16:04:48.896153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.896126 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:04:48.952383 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952383 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhbjn\" (UniqueName: \"kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:48.952725 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:48.952609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhbjn\" (UniqueName: \"kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.053996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.053881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.054407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.054382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.054547 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.054520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.054661 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.054520 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.054806 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.054785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.056243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.056221 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.056361 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.056336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.063720 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.063669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhbjn\" (UniqueName: \"kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn\") pod \"console-896cdbb55-fkm8x\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.141518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.141428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.182371 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.182341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:04:49.246936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.246885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.330913 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.330882 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:04:49.333931 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:49.333906 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050def0c_54e4_4265_b8c0_5b62d08a9807.slice/crio-531dd43a0e997cd0d4bf96ed84ba156f5f3525e1c83db064b27c2a5062d9ad96 WatchSource:0}: Error finding container 531dd43a0e997cd0d4bf96ed84ba156f5f3525e1c83db064b27c2a5062d9ad96: Status 404 returned error can't find the container with id 531dd43a0e997cd0d4bf96ed84ba156f5f3525e1c83db064b27c2a5062d9ad96 Jul 08 16:04:49.354596 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.354509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.565845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.565793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.586597 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.586567 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd"] Jul 08 16:04:49.588721 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.588699 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.591894 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.591878 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-s9qmt\"" Jul 08 16:04:49.592121 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.592106 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 16:04:49.592204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.592165 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 16:04:49.600356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.600337 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd"] Jul 08 16:04:49.602147 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.602132 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.604962 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.604944 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 16:04:49.605175 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.605160 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 16:04:49.605231 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.605184 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 16:04:49.605276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.605161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tvj2p\"" Jul 08 16:04:49.617639 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.617614 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd"] Jul 08 16:04:49.644262 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.644233 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd"] Jul 08 16:04:49.657083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccc5739-6882-4990-a121-417ba8732073-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.657241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.657241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1351d239-5c97-4958-b286-13aba2e84c63-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657182 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lnl9\" (UniqueName: \"kubernetes.io/projected/1351d239-5c97-4958-b286-13aba2e84c63-kube-api-access-8lnl9\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqld\" (UniqueName: \"kubernetes.io/projected/fccc5739-6882-4990-a121-417ba8732073-kube-api-access-2fqld\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.657475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657284 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.657475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.657424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.662190 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.662165 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-82zqb"] Jul 08 16:04:49.664216 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.664201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.668288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.668267 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 16:04:49.672293 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.672271 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2kxh\"" Jul 08 16:04:49.672401 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.672319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 16:04:49.672463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.672400 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 16:04:49.711050 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.710987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.758452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-sys\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccc5739-6882-4990-a121-417ba8732073-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1351d239-5c97-4958-b286-13aba2e84c63-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.758659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-root\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-accelerators-collector-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lnl9\" (UniqueName: \"kubernetes.io/projected/1351d239-5c97-4958-b286-13aba2e84c63-kube-api-access-8lnl9\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqld\" (UniqueName: \"kubernetes.io/projected/fccc5739-6882-4990-a121-417ba8732073-kube-api-access-2fqld\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758864 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9gj\" (UniqueName: \"kubernetes.io/projected/842674c5-bf9e-47b6-afe0-e018786f2459-kube-api-access-px9gj\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-wtmp\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-metrics-client-ca\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-textfile\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.758990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.759023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1351d239-5c97-4958-b286-13aba2e84c63-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:49.759140 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:49.759197 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls podName:1351d239-5c97-4958-b286-13aba2e84c63 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:50.259179202 +0000 UTC m=+61.841051708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mwtmd" (UID: "1351d239-5c97-4958-b286-13aba2e84c63") : secret "kube-state-metrics-tls" not found Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759387 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fccc5739-6882-4990-a121-417ba8732073-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.759544 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.759728 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.759664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.761268 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.761245 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.761380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.761364 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.761605 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.761588 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fccc5739-6882-4990-a121-417ba8732073-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.768771 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.768752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lnl9\" (UniqueName: \"kubernetes.io/projected/1351d239-5c97-4958-b286-13aba2e84c63-kube-api-access-8lnl9\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:49.770737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.770707 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqld\" (UniqueName: \"kubernetes.io/projected/fccc5739-6882-4990-a121-417ba8732073-kube-api-access-2fqld\") pod \"openshift-state-metrics-54cf96dfcf-ndfdd\" (UID: \"fccc5739-6882-4990-a121-417ba8732073\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:49.781930 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.781901 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896cdbb55-fkm8x" event={"ID":"050def0c-54e4-4265-b8c0-5b62d08a9807","Type":"ContainerStarted","Data":"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c"} Jul 08 16:04:49.782064 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.781953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896cdbb55-fkm8x" event={"ID":"050def0c-54e4-4265-b8c0-5b62d08a9807","Type":"ContainerStarted","Data":"531dd43a0e997cd0d4bf96ed84ba156f5f3525e1c83db064b27c2a5062d9ad96"} Jul 08 16:04:49.789229 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.789201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:49.802434 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.802389 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-896cdbb55-fkm8x" podStartSLOduration=1.8023737899999999 podStartE2EDuration="1.80237379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:49.80141078 +0000 UTC m=+61.383283292" watchObservedRunningTime="2026-07-08 16:04:49.80237379 +0000 UTC m=+61.384246300" Jul 08 16:04:49.860476 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-textfile\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.860476 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860521 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-sys\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:49.860548 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-root\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:04:49.860625 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls podName:842674c5-bf9e-47b6-afe0-e018786f2459 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:50.360604781 +0000 UTC m=+61.942477287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls") pod "node-exporter-82zqb" (UID: "842674c5-bf9e-47b6-afe0-e018786f2459") : secret "node-exporter-tls" not found Jul 08 16:04:49.860694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-accelerators-collector-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9gj\" (UniqueName: \"kubernetes.io/projected/842674c5-bf9e-47b6-afe0-e018786f2459-kube-api-access-px9gj\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-textfile\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-wtmp\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-metrics-client-ca\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.860935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-sys\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.861089 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-root\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.861270 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-accelerators-collector-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.861356 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-wtmp\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.861494 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.861409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/842674c5-bf9e-47b6-afe0-e018786f2459-metrics-client-ca\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.862997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.862978 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.869730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.869713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9gj\" (UniqueName: \"kubernetes.io/projected/842674c5-bf9e-47b6-afe0-e018786f2459-kube-api-access-px9gj\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:49.897711 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:49.897677 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" Jul 08 16:04:50.026738 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.026713 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd"] Jul 08 16:04:50.027618 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:50.027590 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccc5739_6882_4990_a121_417ba8732073.slice/crio-24d6e20dd1dbf1107673addd1f3964e49f3f49ce9802c788558222aca79c382a WatchSource:0}: Error finding container 24d6e20dd1dbf1107673addd1f3964e49f3f49ce9802c788558222aca79c382a: Status 404 returned error can't find the container with id 24d6e20dd1dbf1107673addd1f3964e49f3f49ce9802c788558222aca79c382a Jul 08 16:04:50.030562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.030536 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.220380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.220343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.264782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.264747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:50.267439 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.267411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1351d239-5c97-4958-b286-13aba2e84c63-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mwtmd\" (UID: \"1351d239-5c97-4958-b286-13aba2e84c63\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:50.322521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.322485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.365329 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.365240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:50.367896 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.367869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/842674c5-bf9e-47b6-afe0-e018786f2459-node-exporter-tls\") pod \"node-exporter-82zqb\" (UID: \"842674c5-bf9e-47b6-afe0-e018786f2459\") " pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:50.518159 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.518126 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tvj2p\"" Jul 08 16:04:50.524054 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.524016 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" Jul 08 16:04:50.563212 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.563162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.579142 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.579115 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2kxh\"" Jul 08 16:04:50.584180 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.584157 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-82zqb" Jul 08 16:04:50.595685 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:50.595656 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842674c5_bf9e_47b6_afe0_e018786f2459.slice/crio-b00ae98db2137e56e5c3c6faa1a3b807847f2ecdd23688b58543c7991021b7b3 WatchSource:0}: Error finding container b00ae98db2137e56e5c3c6faa1a3b807847f2ecdd23688b58543c7991021b7b3: Status 404 returned error can't find the container with id b00ae98db2137e56e5c3c6faa1a3b807847f2ecdd23688b58543c7991021b7b3 Jul 08 16:04:50.621472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.621386 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:50.621472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.621470 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:50.627574 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.627548 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:50.661514 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.661474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.675490 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.675468 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd"] Jul 08 16:04:50.677360 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:50.677331 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1351d239_5c97_4958_b286_13aba2e84c63.slice/crio-eb5f40dad216262e54b8536f39f2976aa6f9517318ac075c5bc0c920b8d47ca8 WatchSource:0}: Error finding container eb5f40dad216262e54b8536f39f2976aa6f9517318ac075c5bc0c920b8d47ca8: Status 404 returned error can't find the container with id eb5f40dad216262e54b8536f39f2976aa6f9517318ac075c5bc0c920b8d47ca8 Jul 08 16:04:50.787707 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.786836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" event={"ID":"1351d239-5c97-4958-b286-13aba2e84c63","Type":"ContainerStarted","Data":"eb5f40dad216262e54b8536f39f2976aa6f9517318ac075c5bc0c920b8d47ca8"} Jul 08 16:04:50.788306 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.788275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82zqb" event={"ID":"842674c5-bf9e-47b6-afe0-e018786f2459","Type":"ContainerStarted","Data":"b00ae98db2137e56e5c3c6faa1a3b807847f2ecdd23688b58543c7991021b7b3"} Jul 08 16:04:50.789476 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.789447 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:50.790328 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.790307 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" event={"ID":"fccc5739-6882-4990-a121-417ba8732073","Type":"ContainerStarted","Data":"e8b795c3da5142b2b0ffcfd5f276411bd93b8aab060a3ffbe8a8a86527c4b54d"} Jul 08 16:04:50.790411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.790359 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" event={"ID":"fccc5739-6882-4990-a121-417ba8732073","Type":"ContainerStarted","Data":"e111b6eda72ff39aafb82883a8ef71744e51ab234dc3c57ad45fd74176cf5683"} Jul 08 16:04:50.790411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.790385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" event={"ID":"fccc5739-6882-4990-a121-417ba8732073","Type":"ContainerStarted","Data":"24d6e20dd1dbf1107673addd1f3964e49f3f49ce9802c788558222aca79c382a"} Jul 08 16:04:50.794681 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.794661 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:04:50.888411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:50.888324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:51.797767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:51.797674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" event={"ID":"fccc5739-6882-4990-a121-417ba8732073","Type":"ContainerStarted","Data":"8c6a037db8609603e73e6911542b4fdecbf8aa294800f766d1354d3d3db5e042"} Jul 08 16:04:51.835315 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:51.835255 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-ndfdd" podStartSLOduration=1.5287577890000001 podStartE2EDuration="2.835231311s" totalImagesPullingTime="1.306473522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:51.834364261 +0000 UTC m=+63.416236803" watchObservedRunningTime="2026-07-08 16:04:51.835231311 +0000 UTC m=+63.417103825" Jul 08 16:04:52.589625 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.589590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:52.691955 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.691890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:52.757140 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.757101 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wwrrt" Jul 08 16:04:52.803831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.803794 2572 generic.go:356] "Generic (PLEG): container finished" podID="842674c5-bf9e-47b6-afe0-e018786f2459" containerID="28098362bff81b8160b6e038f193ca8dd67a74209101ee5a6f9d4d8aaca30ff0" exitCode=0 Jul 08 16:04:52.804318 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.803877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82zqb" event={"ID":"842674c5-bf9e-47b6-afe0-e018786f2459","Type":"ContainerDied","Data":"28098362bff81b8160b6e038f193ca8dd67a74209101ee5a6f9d4d8aaca30ff0"} Jul 08 16:04:52.833794 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.833758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:52.984375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:52.984341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:53.674402 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.674377 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26bt2" Jul 08 16:04:53.809209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.809167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" event={"ID":"1351d239-5c97-4958-b286-13aba2e84c63","Type":"ContainerStarted","Data":"cbd2ca497afd979acb3508d1e772fd91f5a73a59574ca8811eccff945700f3cb"} Jul 08 16:04:53.809674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.809249 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" event={"ID":"1351d239-5c97-4958-b286-13aba2e84c63","Type":"ContainerStarted","Data":"f00ff5f2199133c9265f86567c946db0b350300c4c2e33891c1874f2a30f0317"} Jul 08 16:04:53.809674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.809281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" event={"ID":"1351d239-5c97-4958-b286-13aba2e84c63","Type":"ContainerStarted","Data":"7c21ba301d0e1bfc79c097e2c5b99c642c66919b27f9608c22f31494467f3b8e"} Jul 08 16:04:53.811309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.811278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82zqb" event={"ID":"842674c5-bf9e-47b6-afe0-e018786f2459","Type":"ContainerStarted","Data":"68c398bc18f3ccc45c2d2a5b6ad2bc382ea406c31a87b03bace240782b4157c8"} Jul 08 16:04:53.811404 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.811328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-82zqb" event={"ID":"842674c5-bf9e-47b6-afe0-e018786f2459","Type":"ContainerStarted","Data":"ef48d9850aebf3ca9f0bce33075524bed645f42c5bdb338b9e146510a13dabfe"} Jul 08 16:04:53.833513 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.833456 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mwtmd" podStartSLOduration=2.464999662 podStartE2EDuration="4.833442329s" totalImagesPullingTime="2.368442667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:53.833244474 +0000 UTC m=+65.415117006" watchObservedRunningTime="2026-07-08 16:04:53.833442329 +0000 UTC m=+65.415314840" Jul 08 16:04:53.837620 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.837599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:53.857588 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.857540 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-82zqb" podStartSLOduration=3.387878835 podStartE2EDuration="4.857519572s" totalImagesPullingTime="1.406975186s" totalInitContainerRuntime="62.665551ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:53.856359829 +0000 UTC m=+65.438232340" watchObservedRunningTime="2026-07-08 16:04:53.857519572 +0000 UTC m=+65.439392083" Jul 08 16:04:53.963175 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:53.963080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.063502 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.063469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.331495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.331407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.409365 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.409327 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.633758 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.633665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.699363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.699329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.861711 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.861683 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4"] Jul 08 16:04:54.866682 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.866662 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.870168 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.870147 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 16:04:54.871464 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.871446 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fd445\"" Jul 08 16:04:54.871655 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.871638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 16:04:54.871806 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.871676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 16:04:54.871806 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.871678 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 16:04:54.874102 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.874085 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 16:04:54.876407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.876389 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 16:04:54.887068 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.886987 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4"] Jul 08 16:04:54.905269 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905237 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905269 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905278 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-metrics-client-ca\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905480 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905525 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905585 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905565 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-serving-certs-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905710 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.905787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.905767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-federate-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.906107 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.906086 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmg9\" (UniqueName: \"kubernetes.io/projected/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-kube-api-access-8cmg9\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:54.939262 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.939230 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:04:54.984245 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.984213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:54.987966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.987944 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:04:54.991653 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:54.991633 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.005080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.005055 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:04:55.007395 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.007501 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-serving-certs-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.007623 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.007739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.007739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.007843 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007738 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-federate-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.007843 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.007981 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.007962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.008148 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.008249 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmg9\" (UniqueName: \"kubernetes.io/projected/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-kube-api-access-8cmg9\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.008249 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.008359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-metrics-client-ca\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.008359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-serving-certs-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.008359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twsh\" (UniqueName: \"kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.008500 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.008500 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.008429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.009211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.009182 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-metrics-client-ca\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.009330 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.009300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.010427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.010397 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.010492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.010474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-telemeter-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.010539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.010522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.010574 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.010541 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-federate-client-tls\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.022223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.022201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmg9\" (UniqueName: \"kubernetes.io/projected/b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409-kube-api-access-8cmg9\") pod \"telemeter-client-5fb6b7b48b-7x6b4\" (UID: \"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409\") " pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.067957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.067925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:55.109596 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109596 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twsh\" (UniqueName: \"kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.109813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.109779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.110450 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.110422 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.110559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.110453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.110559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.110470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.110559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.110546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.112728 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.112699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.112813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.112698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.119446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.119427 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twsh\" (UniqueName: \"kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh\") pod \"console-6f99b6c5db-7bg5n\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.145735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.145637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:55.175661 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.175626 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" Jul 08 16:04:55.250604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.250573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:55.299774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.299731 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:04:55.334092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.334066 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4"] Jul 08 16:04:55.336491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.336455 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:55.336944 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:55.336916 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c7e8e3_5ffe_45a1_8dc6_7eb78ca9c409.slice/crio-f68840cb78efb7e0dd534cb8f532c1e0065e612524a817f143c9539284b9c31b WatchSource:0}: Error finding container f68840cb78efb7e0dd534cb8f532c1e0065e612524a817f143c9539284b9c31b: Status 404 returned error can't find the container with id f68840cb78efb7e0dd534cb8f532c1e0065e612524a817f143c9539284b9c31b Jul 08 16:04:55.428532 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.428508 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:04:55.430953 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:55.430928 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f33c7d2_bd9c_4132_a3da_131d8c4383ed.slice/crio-dfd2f2d5ae8b99617972cd7334324ba34153eb8102a73a5c2296255179114373 WatchSource:0}: Error finding container dfd2f2d5ae8b99617972cd7334324ba34153eb8102a73a5c2296255179114373: Status 404 returned error can't find the container with id dfd2f2d5ae8b99617972cd7334324ba34153eb8102a73a5c2296255179114373 Jul 08 16:04:55.820359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.820257 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f99b6c5db-7bg5n" event={"ID":"5f33c7d2-bd9c-4132-a3da-131d8c4383ed","Type":"ContainerStarted","Data":"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c"} Jul 08 16:04:55.820359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.820317 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f99b6c5db-7bg5n" event={"ID":"5f33c7d2-bd9c-4132-a3da-131d8c4383ed","Type":"ContainerStarted","Data":"dfd2f2d5ae8b99617972cd7334324ba34153eb8102a73a5c2296255179114373"} Jul 08 16:04:55.821580 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.821551 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" event={"ID":"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409","Type":"ContainerStarted","Data":"f68840cb78efb7e0dd534cb8f532c1e0065e612524a817f143c9539284b9c31b"} Jul 08 16:04:55.844327 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.841983 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f99b6c5db-7bg5n" podStartSLOduration=1.8419640670000001 podStartE2EDuration="1.841964067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:55.839795012 +0000 UTC m=+67.421667515" watchObservedRunningTime="2026-07-08 16:04:55.841964067 +0000 UTC m=+67.423836579" Jul 08 16:04:55.908056 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:55.907981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:56.220874 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.220825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:56.221254 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.221233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:56.224898 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.224556 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:04:56.224898 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.224778 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:04:56.233754 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.233729 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74a247e1-67ea-48e8-a307-77250c689099-original-pull-secret\") pod \"global-pull-secret-syncer-wtqbv\" (UID: \"74a247e1-67ea-48e8-a307-77250c689099\") " pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:56.234024 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.234001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5f2c980-d091-4f8a-9d1b-02a65eee3884-metrics-certs\") pod \"network-metrics-daemon-xqx9p\" (UID: \"e5f2c980-d091-4f8a-9d1b-02a65eee3884\") " pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:56.322708 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.322675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:56.325875 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.325851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:04:56.335879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.335850 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:04:56.347010 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.346984 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jq8\" (UniqueName: \"kubernetes.io/projected/17b392ab-3a13-4bed-b38f-96a46c306345-kube-api-access-q9jq8\") pod \"network-check-target-ppbqf\" (UID: \"17b392ab-3a13-4bed-b38f-96a46c306345\") " pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:56.382025 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.381987 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pr5b4\"" Jul 08 16:04:56.382471 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.382455 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wzt7p\"" Jul 08 16:04:56.384553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.384531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wtqbv" Jul 08 16:04:56.385609 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.385582 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:04:56.390813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.390798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xqx9p" Jul 08 16:04:56.556356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.556321 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wtqbv"] Jul 08 16:04:56.560274 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:56.560226 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a247e1_67ea_48e8_a307_77250c689099.slice/crio-44cd95cbc223359ae72dff10bf67867fd5ac99aec2883048b8a3fee8757d1269 WatchSource:0}: Error finding container 44cd95cbc223359ae72dff10bf67867fd5ac99aec2883048b8a3fee8757d1269: Status 404 returned error can't find the container with id 44cd95cbc223359ae72dff10bf67867fd5ac99aec2883048b8a3fee8757d1269 Jul 08 16:04:56.776821 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.776743 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xqx9p"] Jul 08 16:04:56.780024 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:56.779978 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f2c980_d091_4f8a_9d1b_02a65eee3884.slice/crio-f5f037d68ed30d48b25a52781ecf4850ad23dde4d07f04f9f57a4ff25d4b32bc WatchSource:0}: Error finding container f5f037d68ed30d48b25a52781ecf4850ad23dde4d07f04f9f57a4ff25d4b32bc: Status 404 returned error can't find the container with id f5f037d68ed30d48b25a52781ecf4850ad23dde4d07f04f9f57a4ff25d4b32bc Jul 08 16:04:56.781959 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.781908 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ppbqf"] Jul 08 16:04:56.784027 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:04:56.783993 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b392ab_3a13_4bed_b38f_96a46c306345.slice/crio-37561144fff757c6d9deea07fb10d8a0009a02082eef135677a41cfd6bcff311 WatchSource:0}: Error finding container 37561144fff757c6d9deea07fb10d8a0009a02082eef135677a41cfd6bcff311: Status 404 returned error can't find the container with id 37561144fff757c6d9deea07fb10d8a0009a02082eef135677a41cfd6bcff311 Jul 08 16:04:56.826308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.826270 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqx9p" event={"ID":"e5f2c980-d091-4f8a-9d1b-02a65eee3884","Type":"ContainerStarted","Data":"f5f037d68ed30d48b25a52781ecf4850ad23dde4d07f04f9f57a4ff25d4b32bc"} Jul 08 16:04:56.827295 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.827271 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wtqbv" event={"ID":"74a247e1-67ea-48e8-a307-77250c689099","Type":"ContainerStarted","Data":"44cd95cbc223359ae72dff10bf67867fd5ac99aec2883048b8a3fee8757d1269"} Jul 08 16:04:56.828370 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:56.828351 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ppbqf" event={"ID":"17b392ab-3a13-4bed-b38f-96a46c306345","Type":"ContainerStarted","Data":"37561144fff757c6d9deea07fb10d8a0009a02082eef135677a41cfd6bcff311"} Jul 08 16:04:57.022760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:57.022720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:57.126159 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:57.126072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:57.227793 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:57.227754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:57.348344 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:57.348311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:57.449953 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:57.449919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:58.166052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.165986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:58.337668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.337605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:58.587271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.587232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:58.684486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.684443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:58.841991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.841902 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqx9p" event={"ID":"e5f2c980-d091-4f8a-9d1b-02a65eee3884","Type":"ContainerStarted","Data":"09470bb337a55588643a33ef37207706f227d373d7ac6ddbdd73fd30a855b42b"} Jul 08 16:04:58.841991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.841974 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xqx9p" event={"ID":"e5f2c980-d091-4f8a-9d1b-02a65eee3884","Type":"ContainerStarted","Data":"2cfe51983e670ebcf90ff643bbf07b33b32be135d1ca42aee68f18695631c7dc"} Jul 08 16:04:58.844446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.844412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" event={"ID":"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409","Type":"ContainerStarted","Data":"7f9fb2cd348ae0ff729aaa88a69f2a1a2f1bc77b3378301ea5564e0ef8ff20cd"} Jul 08 16:04:58.862953 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.862547 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xqx9p" podStartSLOduration=66.492571267 podStartE2EDuration="1m7.862525413s" totalImagesPullingTime="1.369954146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:58.860394517 +0000 UTC m=+70.442267026" watchObservedRunningTime="2026-07-08 16:04:58.862525413 +0000 UTC m=+70.444397926" Jul 08 16:04:58.954696 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:58.954608 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:59.055707 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:59.055656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:59.123595 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:59.123521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:59.183579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:04:59.183525 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:05:01.357157 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:01.357104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:01.459346 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:01.459309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:02.862113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.862072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" event={"ID":"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409","Type":"ContainerStarted","Data":"1c82bf489ac715f5fd22aa6f1d95b84d0b1e39251bc379d5e32076817513a5ec"} Jul 08 16:05:02.862627 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.862144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" event={"ID":"b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409","Type":"ContainerStarted","Data":"7f2db16e7ebe9a824ca7d394a77a3afd975da879a149b957fc871d97b44fc37c"} Jul 08 16:05:02.863568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.863540 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wtqbv" event={"ID":"74a247e1-67ea-48e8-a307-77250c689099","Type":"ContainerStarted","Data":"d62b383ea3469834a283d26c66059de8b721be1cb193b1e1d7ea26242e22235b"} Jul 08 16:05:02.864991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.864969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ppbqf" event={"ID":"17b392ab-3a13-4bed-b38f-96a46c306345","Type":"ContainerStarted","Data":"9648565e58b1195a3b20fd2d13ff33c236b1ebf57c9912242d85cf9142341443"} Jul 08 16:05:02.865119 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.865019 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:05:02.892799 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.892745 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fb6b7b48b-7x6b4" podStartSLOduration=2.099844532 podStartE2EDuration="8.892704183s" totalImagesPullingTime="6.792859651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:02.890787477 +0000 UTC m=+74.472659989" watchObservedRunningTime="2026-07-08 16:05:02.892704183 +0000 UTC m=+74.474576747" Jul 08 16:05:02.930739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.930674 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ppbqf" podStartSLOduration=66.483714395 podStartE2EDuration="1m11.930653627s" totalImagesPullingTime="5.446939232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:02.911111809 +0000 UTC m=+74.492984353" watchObservedRunningTime="2026-07-08 16:05:02.930653627 +0000 UTC m=+74.512526140" Jul 08 16:05:02.931604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:02.931561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wtqbv" podStartSLOduration=66.260859651 podStartE2EDuration="1m11.93154881s" totalImagesPullingTime="5.670689159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:02.930594091 +0000 UTC m=+74.512466603" watchObservedRunningTime="2026-07-08 16:05:02.93154881 +0000 UTC m=+74.513421322" Jul 08 16:05:03.636758 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.636716 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:03.698271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.698235 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:05:03.734202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.734167 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:05:03.737505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.737484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.753819 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.753790 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:05:03.786362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786333 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrr4f\" (UniqueName: \"kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786584 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.786774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.786646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.887842 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.887754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.887842 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.887797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.887927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.887986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrr4f\" (UniqueName: \"kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888713 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888691 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888713 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888851 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888804 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.888984 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.888963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.890561 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.890541 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.891145 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.891124 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:03.898796 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:03.898768 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrr4f\" (UniqueName: \"kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f\") pod \"console-5d5567bfdb-d76l6\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:04.046264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.046224 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:04.141979 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.141888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:04.202883 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.202833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:05:04.206236 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:05:04.206202 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8473cbe_23a2_4fb4_8399_ef80d69a43c2.slice/crio-d2ab15bc174ae2461c370dafe5b7fae6739004d4344a260b4de368a28765fac4 WatchSource:0}: Error finding container d2ab15bc174ae2461c370dafe5b7fae6739004d4344a260b4de368a28765fac4: Status 404 returned error can't find the container with id d2ab15bc174ae2461c370dafe5b7fae6739004d4344a260b4de368a28765fac4 Jul 08 16:05:04.246771 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.246736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:04.748174 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.748139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:04.851230 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.851200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:04.874779 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.874743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5567bfdb-d76l6" event={"ID":"d8473cbe-23a2-4fb4-8399-ef80d69a43c2","Type":"ContainerStarted","Data":"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548"} Jul 08 16:05:04.874950 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.874795 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5567bfdb-d76l6" event={"ID":"d8473cbe-23a2-4fb4-8399-ef80d69a43c2","Type":"ContainerStarted","Data":"d2ab15bc174ae2461c370dafe5b7fae6739004d4344a260b4de368a28765fac4"} Jul 08 16:05:04.901053 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:04.898648 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d5567bfdb-d76l6" podStartSLOduration=1.898628094 podStartE2EDuration="1.898628094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:04.89535643 +0000 UTC m=+76.477228941" watchObservedRunningTime="2026-07-08 16:05:04.898628094 +0000 UTC m=+76.480500609" Jul 08 16:05:05.300547 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:05.300505 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:05:06.187473 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:06.187427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:06.392010 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:06.391975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:12.141734 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:12.141595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:12.243909 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:12.243880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:14.047439 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:14.047394 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:14.047933 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:14.047474 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:14.051991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:14.051970 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:14.917133 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:14.917103 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:05:14.973936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:14.973898 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:05:15.133431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:15.133394 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:15.221837 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:15.221806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:18.967581 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:18.967544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:19.049093 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:19.049027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:19.958883 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:19.958842 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-896cdbb55-fkm8x" podUID="050def0c-54e4-4265-b8c0-5b62d08a9807" containerName="console" containerID="cri-o://d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c" gracePeriod=15 Jul 08 16:05:20.197646 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.197604 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:05:20.327517 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327421 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327517 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327458 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327517 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327495 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327521 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327541 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327563 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327616 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhbjn\" (UniqueName: \"kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn\") pod \"050def0c-54e4-4265-b8c0-5b62d08a9807\" (UID: \"050def0c-54e4-4265-b8c0-5b62d08a9807\") " Jul 08 16:05:20.327983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327907 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config" (OuterVolumeSpecName: "console-config") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:20.327983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.327939 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:20.328119 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.328063 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca" (OuterVolumeSpecName: "service-ca") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:20.328239 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.328210 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:20.329970 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.329939 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:20.330120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.329969 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn" (OuterVolumeSpecName: "kube-api-access-bhbjn") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "kube-api-access-bhbjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:20.330120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.330006 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "050def0c-54e4-4265-b8c0-5b62d08a9807" (UID: "050def0c-54e4-4265-b8c0-5b62d08a9807"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:20.429251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429207 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429251 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-console-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429262 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/050def0c-54e4-4265-b8c0-5b62d08a9807-console-oauth-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429285 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-oauth-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429293 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-service-ca\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429302 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/050def0c-54e4-4265-b8c0-5b62d08a9807-trusted-ca-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.429495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.429310 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhbjn\" (UniqueName: \"kubernetes.io/projected/050def0c-54e4-4265-b8c0-5b62d08a9807-kube-api-access-bhbjn\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:20.936657 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.936618 2572 generic.go:356] "Generic (PLEG): container finished" podID="050def0c-54e4-4265-b8c0-5b62d08a9807" containerID="d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c" exitCode=0 Jul 08 16:05:20.936828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.936663 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896cdbb55-fkm8x" Jul 08 16:05:20.936828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.936707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896cdbb55-fkm8x" event={"ID":"050def0c-54e4-4265-b8c0-5b62d08a9807","Type":"ContainerDied","Data":"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c"} Jul 08 16:05:20.936828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.936761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896cdbb55-fkm8x" event={"ID":"050def0c-54e4-4265-b8c0-5b62d08a9807","Type":"ContainerDied","Data":"531dd43a0e997cd0d4bf96ed84ba156f5f3525e1c83db064b27c2a5062d9ad96"} Jul 08 16:05:20.936828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.936802 2572 scope.go:117] "RemoveContainer" containerID="d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c" Jul 08 16:05:20.944642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.944624 2572 scope.go:117] "RemoveContainer" containerID="d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c" Jul 08 16:05:20.944885 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:05:20.944865 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c\": container with ID starting with d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c not found: ID does not exist" containerID="d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c" Jul 08 16:05:20.944948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.944893 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c"} err="failed to get container status \"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c\": rpc error: code = NotFound desc = could not find container \"d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c\": container with ID starting with d390fd95ceb1d53489f3707e94c4a0be5f83a8b9405ebc24d85cc5610324312c not found: ID does not exist" Jul 08 16:05:20.956745 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.956711 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:05:20.963708 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:20.963684 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-896cdbb55-fkm8x"] Jul 08 16:05:22.469424 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:22.469392 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="050def0c-54e4-4265-b8c0-5b62d08a9807" path="/var/lib/kubelet/pods/050def0c-54e4-4265-b8c0-5b62d08a9807/volumes" Jul 08 16:05:28.720287 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.720216 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f99b6c5db-7bg5n" podUID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" containerName="console" containerID="cri-o://ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c" gracePeriod=15 Jul 08 16:05:28.973717 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.973648 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:05:28.975058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.975016 2572 generic.go:356] "Generic (PLEG): container finished" podID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" containerID="ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c" exitCode=0 Jul 08 16:05:28.975185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.975069 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f99b6c5db-7bg5n" Jul 08 16:05:28.975185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.975108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f99b6c5db-7bg5n" event={"ID":"5f33c7d2-bd9c-4132-a3da-131d8c4383ed","Type":"ContainerDied","Data":"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c"} Jul 08 16:05:28.975185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.975175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f99b6c5db-7bg5n" event={"ID":"5f33c7d2-bd9c-4132-a3da-131d8c4383ed","Type":"ContainerDied","Data":"dfd2f2d5ae8b99617972cd7334324ba34153eb8102a73a5c2296255179114373"} Jul 08 16:05:28.975287 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.975196 2572 scope.go:117] "RemoveContainer" containerID="ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c" Jul 08 16:05:28.983647 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.983627 2572 scope.go:117] "RemoveContainer" containerID="ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c" Jul 08 16:05:28.983990 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:05:28.983965 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c\": container with ID starting with ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c not found: ID does not exist" containerID="ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c" Jul 08 16:05:28.984141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:28.984001 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c"} err="failed to get container status \"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c\": rpc error: code = NotFound desc = could not find container \"ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c\": container with ID starting with ae48eb1e6d1d2d90a424224de4699f8166ef5ae7f4eb0a004d1f5d9db391552c not found: ID does not exist" Jul 08 16:05:29.099720 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099679 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099722 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099754 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4twsh\" (UniqueName: \"kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099780 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099830 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099855 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.099918 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.099887 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config\") pod \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\" (UID: \"5f33c7d2-bd9c-4132-a3da-131d8c4383ed\") " Jul 08 16:05:29.100285 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.100260 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:29.100393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.100361 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config" (OuterVolumeSpecName: "console-config") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:29.100393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.100377 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:29.100393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.100370 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:29.102081 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.102027 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:29.102192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.102071 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh" (OuterVolumeSpecName: "kube-api-access-4twsh") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "kube-api-access-4twsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:29.102192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.102114 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f33c7d2-bd9c-4132-a3da-131d8c4383ed" (UID: "5f33c7d2-bd9c-4132-a3da-131d8c4383ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:29.200531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200484 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200523 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-service-ca\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200532 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twsh\" (UniqueName: \"kubernetes.io/projected/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-kube-api-access-4twsh\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200542 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-trusted-ca-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200797 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200551 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-oauth-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200797 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200559 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.200797 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.200567 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f33c7d2-bd9c-4132-a3da-131d8c4383ed-console-oauth-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:29.297872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.297841 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:05:29.301897 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:29.301871 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f99b6c5db-7bg5n"] Jul 08 16:05:30.469841 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:30.469805 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" path="/var/lib/kubelet/pods/5f33c7d2-bd9c-4132-a3da-131d8c4383ed/volumes" Jul 08 16:05:31.435445 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:31.435412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xrs2h_2ef20300-0f27-48c0-b335-39fe6346461e/serve-healthcheck-canary/0.log" Jul 08 16:05:33.872587 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:33.872555 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ppbqf" Jul 08 16:05:34.963485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:34.963451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:35.065481 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:35.065425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:35.204839 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:35.204806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:39.994164 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:39.994125 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-745647bf97-ws7vc" podUID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" containerName="console" containerID="cri-o://01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3" gracePeriod=15 Jul 08 16:05:40.224434 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.224411 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:05:40.287568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287480 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287527 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287563 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287807 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287590 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287807 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287617 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrwks\" (UniqueName: \"kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287807 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287648 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca\") pod \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\" (UID: \"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7\") " Jul 08 16:05:40.287945 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287918 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config" (OuterVolumeSpecName: "console-config") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:40.287997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.287948 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:40.288201 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.288183 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:40.289829 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.289794 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:40.289933 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.289836 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks" (OuterVolumeSpecName: "kube-api-access-vrwks") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "kube-api-access-vrwks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:40.289933 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.289845 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" (UID: "7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:05:40.388265 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388231 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-oauth-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:40.388265 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388263 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-oauth-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:40.388491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388278 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:40.388491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388292 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrwks\" (UniqueName: \"kubernetes.io/projected/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-kube-api-access-vrwks\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:40.388491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388307 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-service-ca\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:40.388491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:40.388321 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7-console-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:05:41.021491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.021456 2572 generic.go:356] "Generic (PLEG): container finished" podID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" containerID="01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3" exitCode=0 Jul 08 16:05:41.021946 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.021500 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745647bf97-ws7vc" event={"ID":"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7","Type":"ContainerDied","Data":"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3"} Jul 08 16:05:41.021946 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.021511 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745647bf97-ws7vc" Jul 08 16:05:41.021946 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.021553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745647bf97-ws7vc" event={"ID":"7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7","Type":"ContainerDied","Data":"b2457f710125bfaaf3f73ceb647db283049b354dc4cd7d8be7c5b397848a6472"} Jul 08 16:05:41.021946 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.021583 2572 scope.go:117] "RemoveContainer" containerID="01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3" Jul 08 16:05:41.030833 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.030812 2572 scope.go:117] "RemoveContainer" containerID="01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3" Jul 08 16:05:41.031158 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:05:41.031121 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3\": container with ID starting with 01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3 not found: ID does not exist" containerID="01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3" Jul 08 16:05:41.031230 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.031149 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3"} err="failed to get container status \"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3\": rpc error: code = NotFound desc = could not find container \"01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3\": container with ID starting with 01f5d88ff7f7f44be40773ff9b5d19a3da14ca905d30b608c43c4dc7bf14e9f3 not found: ID does not exist" Jul 08 16:05:41.042238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.042211 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:05:41.044921 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:41.044899 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745647bf97-ws7vc"] Jul 08 16:05:42.469912 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:05:42.469879 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" path="/var/lib/kubelet/pods/7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7/volumes" Jul 08 16:06:00.181019 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:00.180983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:05.759658 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:05.759626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:06.119074 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:06.118972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:12.306687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.306651 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307642 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050def0c-54e4-4265-b8c0-5b62d08a9807" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307672 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="050def0c-54e4-4265-b8c0-5b62d08a9807" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307695 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307704 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307715 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307730 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307895 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f49ed36-b3e0-4710-ac55-d9d8eddb9ad7" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307907 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="050def0c-54e4-4265-b8c0-5b62d08a9807" containerName="console" Jul 08 16:06:12.308980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.307917 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f33c7d2-bd9c-4132-a3da-131d8c4383ed" containerName="console" Jul 08 16:06:12.313976 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.313954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.317173 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317146 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 16:06:12.317173 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317178 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317192 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317209 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dsp2c\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317224 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317269 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317226 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317181 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 16:06:12.317367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.317181 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 16:06:12.322726 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.322699 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 16:06:12.323451 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.323433 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:06:12.436621 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436621 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-web-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-out\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.436828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xhl\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-kube-api-access-v2xhl\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.437016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.437016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.437016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.437016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.437016 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.436939 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xhl\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-kube-api-access-v2xhl\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538357 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-web-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-out\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.538630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.538604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.539169 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.539065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.539513 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.539487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.539736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.539713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb8e3674-3125-4f8a-a421-fa41601fc6fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.541440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.541411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.541731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.541827 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-web-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.541991 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.542010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542284 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.542073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542564 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.542547 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb8e3674-3125-4f8a-a421-fa41601fc6fd-config-out\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.542625 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.542598 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.543342 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.543321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb8e3674-3125-4f8a-a421-fa41601fc6fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.546116 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.546094 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xhl\" (UniqueName: \"kubernetes.io/projected/fb8e3674-3125-4f8a-a421-fa41601fc6fd-kube-api-access-v2xhl\") pod \"alertmanager-main-0\" (UID: \"fb8e3674-3125-4f8a-a421-fa41601fc6fd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.624285 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.624186 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 16:06:12.783825 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:12.783802 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 16:06:12.785804 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:06:12.785777 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8e3674_3125_4f8a_a421_fa41601fc6fd.slice/crio-360b62bdab7e769712bb33783b512abedccab8cc63e882b26c5812ff1516e357 WatchSource:0}: Error finding container 360b62bdab7e769712bb33783b512abedccab8cc63e882b26c5812ff1516e357: Status 404 returned error can't find the container with id 360b62bdab7e769712bb33783b512abedccab8cc63e882b26c5812ff1516e357 Jul 08 16:06:13.137407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:13.137374 2572 generic.go:356] "Generic (PLEG): container finished" podID="fb8e3674-3125-4f8a-a421-fa41601fc6fd" containerID="4ea7079049a50c2404efc773559dc081305e6615cef32f6ca4fcd09434152c90" exitCode=0 Jul 08 16:06:13.137609 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:13.137435 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerDied","Data":"4ea7079049a50c2404efc773559dc081305e6615cef32f6ca4fcd09434152c90"} Jul 08 16:06:13.137609 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:13.137525 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"360b62bdab7e769712bb33783b512abedccab8cc63e882b26c5812ff1516e357"} Jul 08 16:06:16.156719 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:16.156683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"37f2309b677b02f0ace69a4decae30e96b7b63d99fa8b7dc9ee71ef058e31cbf"} Jul 08 16:06:16.157160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:16.156763 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"15f6610ac759b4ae5feced4d4d1c3636c33c0d93c4c300e893ee46946fbfcc68"} Jul 08 16:06:16.157160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:16.156802 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"3bdf9d581d884727710a2aadaffb0f127bf887022056feb87e49dc7f08d5bdf8"} Jul 08 16:06:16.157160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:16.156844 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"81dfd5b38c66195addb28f427560740e145f5f51cd4fa009816de5a9b426e4c2"} Jul 08 16:06:16.157160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:16.156887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"6e1966c1b00b74ac9be3aed6884f40ea745d0662ee4453421e6018df24ae98e5"} Jul 08 16:06:17.164231 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:17.164190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb8e3674-3125-4f8a-a421-fa41601fc6fd","Type":"ContainerStarted","Data":"ab5bb24f66854fe8a9e4545151725161ff4cbdf8b666793cf49d781ec1a723fe"} Jul 08 16:06:17.197277 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:17.195875 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.314437536 podStartE2EDuration="5.195852311s" totalImagesPullingTime="2.864302445s" totalInitContainerRuntime="17.11233ms" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:17.193204837 +0000 UTC m=+148.775077348" watchObservedRunningTime="2026-07-08 16:06:17.195852311 +0000 UTC m=+148.777724826" Jul 08 16:06:17.652494 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:17.652461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:17.709491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:17.709464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:22.986977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:22.986947 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:06:22.990233 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:22.990212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.003689 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.003659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:06:23.078691 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.078653 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:23.126296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126258 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126443 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcpv\" (UniqueName: \"kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.126614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.126517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.157663 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.157624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:23.227156 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcpv\" (UniqueName: \"kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227362 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.227623 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.227514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.228397 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.228363 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.228508 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.228393 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.228508 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.228464 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.228508 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.228469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.233778 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.233743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.233902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.233803 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.237406 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.237331 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcpv\" (UniqueName: \"kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv\") pod \"console-6dcdb67bd4-j7dbm\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.258237 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.258201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:23.299391 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.299358 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:23.433085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.433059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:06:23.435483 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:06:23.435454 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8aa1cf_804a_43c1_9426_fd1973209d2e.slice/crio-94b6f8387b44bdc6c5c8518597c0e734f555a85b82d9a88fb581f996fca52b48 WatchSource:0}: Error finding container 94b6f8387b44bdc6c5c8518597c0e734f555a85b82d9a88fb581f996fca52b48: Status 404 returned error can't find the container with id 94b6f8387b44bdc6c5c8518597c0e734f555a85b82d9a88fb581f996fca52b48 Jul 08 16:06:23.786778 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.786685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:23.843600 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:23.843561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:24.190897 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:24.190864 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcdb67bd4-j7dbm" event={"ID":"5c8aa1cf-804a-43c1-9426-fd1973209d2e","Type":"ContainerStarted","Data":"73c6642a7bd321c594e018009d33d0858856bcfad8075bc4dcc02b3e1d492347"} Jul 08 16:06:24.191408 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:24.190909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcdb67bd4-j7dbm" event={"ID":"5c8aa1cf-804a-43c1-9426-fd1973209d2e","Type":"ContainerStarted","Data":"94b6f8387b44bdc6c5c8518597c0e734f555a85b82d9a88fb581f996fca52b48"} Jul 08 16:06:24.210672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:24.210617 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dcdb67bd4-j7dbm" podStartSLOduration=2.2105981630000002 podStartE2EDuration="2.210598163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:24.208945161 +0000 UTC m=+155.790817672" watchObservedRunningTime="2026-07-08 16:06:24.210598163 +0000 UTC m=+155.792470673" Jul 08 16:06:27.140729 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:27.140690 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:27.240510 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:27.240478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:30.665468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:30.665422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:33.299731 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:33.299690 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:33.300152 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:33.299748 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:33.304652 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:33.304628 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:34.232408 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:34.232381 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:06:34.281779 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:34.281749 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:06:34.397237 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:34.397185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:34.499210 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:34.499107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:34.581157 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:34.581127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:46.706436 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:46.706324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:46.757355 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:46.757310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:46.880183 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:46.880145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:59.302175 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.302136 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d5567bfdb-d76l6" podUID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" containerName="console" containerID="cri-o://4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548" gracePeriod=15 Jul 08 16:06:59.538704 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.538676 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:06:59.633325 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633227 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633325 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633272 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633325 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633310 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrr4f\" (UniqueName: \"kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633347 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633366 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633437 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633468 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config\") pod \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\" (UID: \"d8473cbe-23a2-4fb4-8399-ef80d69a43c2\") " Jul 08 16:06:59.633776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633718 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:06:59.633895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633865 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:06:59.633996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.633889 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:06:59.634066 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.634007 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config" (OuterVolumeSpecName: "console-config") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:06:59.635489 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.635467 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:06:59.635933 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.635907 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:06:59.635933 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.635919 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f" (OuterVolumeSpecName: "kube-api-access-xrr4f") pod "d8473cbe-23a2-4fb4-8399-ef80d69a43c2" (UID: "d8473cbe-23a2-4fb4-8399-ef80d69a43c2"). InnerVolumeSpecName "kube-api-access-xrr4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:06:59.734462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734425 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrr4f\" (UniqueName: \"kubernetes.io/projected/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-kube-api-access-xrr4f\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734457 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-oauth-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734467 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734476 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734485 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-console-oauth-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734493 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-trusted-ca-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:06:59.734694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:06:59.734501 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8473cbe-23a2-4fb4-8399-ef80d69a43c2-service-ca\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:07:00.321559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.321519 2572 generic.go:356] "Generic (PLEG): container finished" podID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" containerID="4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548" exitCode=0 Jul 08 16:07:00.322061 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.321565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5567bfdb-d76l6" event={"ID":"d8473cbe-23a2-4fb4-8399-ef80d69a43c2","Type":"ContainerDied","Data":"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548"} Jul 08 16:07:00.322061 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.321573 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d5567bfdb-d76l6" Jul 08 16:07:00.322061 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.321615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d5567bfdb-d76l6" event={"ID":"d8473cbe-23a2-4fb4-8399-ef80d69a43c2","Type":"ContainerDied","Data":"d2ab15bc174ae2461c370dafe5b7fae6739004d4344a260b4de368a28765fac4"} Jul 08 16:07:00.322061 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.321638 2572 scope.go:117] "RemoveContainer" containerID="4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548" Jul 08 16:07:00.333353 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.333333 2572 scope.go:117] "RemoveContainer" containerID="4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548" Jul 08 16:07:00.333716 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:07:00.333695 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548\": container with ID starting with 4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548 not found: ID does not exist" containerID="4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548" Jul 08 16:07:00.333766 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.333723 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548"} err="failed to get container status \"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548\": rpc error: code = NotFound desc = could not find container \"4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548\": container with ID starting with 4179edea22d5e44993ba5aabfe7d2e4872469edec15e2ead4f5656d820677548 not found: ID does not exist" Jul 08 16:07:00.345425 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.345395 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:07:00.348599 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.348575 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d5567bfdb-d76l6"] Jul 08 16:07:00.471029 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:00.470990 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" path="/var/lib/kubelet/pods/d8473cbe-23a2-4fb4-8399-ef80d69a43c2/volumes" Jul 08 16:07:01.506337 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:01.506300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:01.568955 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:01.568926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:25.264712 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:25.264668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:25.365118 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:25.365079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:25.825477 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:25.825440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:25.925769 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:25.925730 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:26.454369 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.454333 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp"] Jul 08 16:07:26.454735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.454650 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" containerName="console" Jul 08 16:07:26.454735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.454661 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" containerName="console" Jul 08 16:07:26.454735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.454707 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8473cbe-23a2-4fb4-8399-ef80d69a43c2" containerName="console" Jul 08 16:07:26.456700 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.456683 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.459525 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.459505 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:07:26.459635 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.459508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqd4t\"" Jul 08 16:07:26.460639 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.460617 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:07:26.470218 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.470192 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp"] Jul 08 16:07:26.540942 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.540907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.541154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.540959 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4277f\" (UniqueName: \"kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.541154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.541030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.642271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.642235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.642429 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.642284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4277f\" (UniqueName: \"kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.642429 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.642312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.642644 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.642623 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.642684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.642668 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.650920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.650895 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4277f\" (UniqueName: \"kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.765876 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.765786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:26.896524 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:26.896494 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp"] Jul 08 16:07:26.899267 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:07:26.899240 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39933eb8_13a4_47cb_973c_9747c5f85ddc.slice/crio-c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070 WatchSource:0}: Error finding container c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070: Status 404 returned error can't find the container with id c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070 Jul 08 16:07:27.423507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:27.423470 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerStarted","Data":"c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070"} Jul 08 16:07:34.453877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:34.453843 2572 generic.go:356] "Generic (PLEG): container finished" podID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerID="7e23a143d860903b355ab250b39a7218597480e20c476e0d39bd70f799bad1cc" exitCode=0 Jul 08 16:07:34.454286 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:34.453910 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerDied","Data":"7e23a143d860903b355ab250b39a7218597480e20c476e0d39bd70f799bad1cc"} Jul 08 16:07:36.472504 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:36.472465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerStarted","Data":"544cb1252432aaa6f9aacae2a0195d820769738a9e4e46447ff0ae1f83242bd2"} Jul 08 16:07:36.696562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:36.696530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:37.475647 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:37.475611 2572 generic.go:356] "Generic (PLEG): container finished" podID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerID="544cb1252432aaa6f9aacae2a0195d820769738a9e4e46447ff0ae1f83242bd2" exitCode=0 Jul 08 16:07:37.476015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:37.475669 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerDied","Data":"544cb1252432aaa6f9aacae2a0195d820769738a9e4e46447ff0ae1f83242bd2"} Jul 08 16:07:45.513307 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:45.513273 2572 generic.go:356] "Generic (PLEG): container finished" podID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerID="6b05c5f4661f271ff54b3b37e017a1403885586131855a988cec7ab2d80506eb" exitCode=0 Jul 08 16:07:45.513676 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:45.513357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerDied","Data":"6b05c5f4661f271ff54b3b37e017a1403885586131855a988cec7ab2d80506eb"} Jul 08 16:07:46.645654 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.645625 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:46.720439 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.720401 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util\") pod \"39933eb8-13a4-47cb-973c-9747c5f85ddc\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " Jul 08 16:07:46.720649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.720473 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle\") pod \"39933eb8-13a4-47cb-973c-9747c5f85ddc\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " Jul 08 16:07:46.720649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.720507 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4277f\" (UniqueName: \"kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f\") pod \"39933eb8-13a4-47cb-973c-9747c5f85ddc\" (UID: \"39933eb8-13a4-47cb-973c-9747c5f85ddc\") " Jul 08 16:07:46.721150 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.721124 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle" (OuterVolumeSpecName: "bundle") pod "39933eb8-13a4-47cb-973c-9747c5f85ddc" (UID: "39933eb8-13a4-47cb-973c-9747c5f85ddc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:07:46.722858 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.722826 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f" (OuterVolumeSpecName: "kube-api-access-4277f") pod "39933eb8-13a4-47cb-973c-9747c5f85ddc" (UID: "39933eb8-13a4-47cb-973c-9747c5f85ddc"). InnerVolumeSpecName "kube-api-access-4277f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:07:46.725057 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.725022 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util" (OuterVolumeSpecName: "util") pod "39933eb8-13a4-47cb-973c-9747c5f85ddc" (UID: "39933eb8-13a4-47cb-973c-9747c5f85ddc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:07:46.822017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.821927 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4277f\" (UniqueName: \"kubernetes.io/projected/39933eb8-13a4-47cb-973c-9747c5f85ddc-kube-api-access-4277f\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:07:46.822017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.821962 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:07:46.822017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:46.821972 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39933eb8-13a4-47cb-973c-9747c5f85ddc-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:07:47.522798 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:47.522765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" event={"ID":"39933eb8-13a4-47cb-973c-9747c5f85ddc","Type":"ContainerDied","Data":"c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070"} Jul 08 16:07:47.522798 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:47.522797 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540g8trp" Jul 08 16:07:47.522994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:47.522809 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c865863e82b9950e45e1742fea64a6a0dc76fea6e7d8341951f84cd81491a070" Jul 08 16:07:52.496310 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:52.496277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:53.461345 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:53.461304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:54.451840 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.451803 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr"] Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452090 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="pull" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452100 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="pull" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452115 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="util" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452120 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="util" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452135 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="extract" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452142 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="extract" Jul 08 16:07:54.452241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.452183 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="39933eb8-13a4-47cb-973c-9747c5f85ddc" containerName="extract" Jul 08 16:07:54.456202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.456180 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.459094 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.459068 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:07:54.459222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.459112 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 16:07:54.459222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.459195 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-clkdd\"" Jul 08 16:07:54.472682 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.472643 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr"] Jul 08 16:07:54.480624 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.480589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmxld\" (UniqueName: \"kubernetes.io/projected/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-kube-api-access-cmxld\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.480768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.480664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.581751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.581712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmxld\" (UniqueName: \"kubernetes.io/projected/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-kube-api-access-cmxld\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.581930 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.581766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.582132 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.582118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.595173 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.595144 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmxld\" (UniqueName: \"kubernetes.io/projected/ca3a4177-0a83-4ebf-a3e8-baa01289c7a2-kube-api-access-cmxld\") pod \"cert-manager-operator-controller-manager-55c444bf86-lxqwr\" (UID: \"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.765662 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.765574 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" Jul 08 16:07:54.902072 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:54.902018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr"] Jul 08 16:07:54.904955 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:07:54.904925 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3a4177_0a83_4ebf_a3e8_baa01289c7a2.slice/crio-f97c4d7ca0b513fa2636d32dcfdfb7086ef67cc2b1f340cf1dc035f5b6135f95 WatchSource:0}: Error finding container f97c4d7ca0b513fa2636d32dcfdfb7086ef67cc2b1f340cf1dc035f5b6135f95: Status 404 returned error can't find the container with id f97c4d7ca0b513fa2636d32dcfdfb7086ef67cc2b1f340cf1dc035f5b6135f95 Jul 08 16:07:55.553867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:55.553833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" event={"ID":"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2","Type":"ContainerStarted","Data":"f97c4d7ca0b513fa2636d32dcfdfb7086ef67cc2b1f340cf1dc035f5b6135f95"} Jul 08 16:07:56.106732 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:56.106700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:56.207048 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:56.206995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:57.565250 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.565216 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" event={"ID":"ca3a4177-0a83-4ebf-a3e8-baa01289c7a2","Type":"ContainerStarted","Data":"58ee76d97005da44dfa8ef884d5e1c97c89d47f1c4878b044080326c56e73a89"} Jul 08 16:07:57.594813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.594747 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lxqwr" podStartSLOduration=1.630925298 podStartE2EDuration="3.594731836s" totalImagesPullingTime="1.963806538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:07:57.593475151 +0000 UTC m=+249.175347681" watchObservedRunningTime="2026-07-08 16:07:57.594731836 +0000 UTC m=+249.176604347" Jul 08 16:07:57.613447 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.613417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:57.696314 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.696268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:57.719965 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.719905 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dkzd"] Jul 08 16:07:57.723249 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.723230 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.725790 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.725720 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 16:07:57.725920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.725884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rjm4b\"" Jul 08 16:07:57.725920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.725914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 16:07:57.731959 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.731934 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dkzd"] Jul 08 16:07:57.808191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.808157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.808191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.808193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljdt2\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-kube-api-access-ljdt2\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.908828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.908736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.908828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.908772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljdt2\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-kube-api-access-ljdt2\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.932475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.932439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:57.932475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:57.932472 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljdt2\" (UniqueName: \"kubernetes.io/projected/2f213863-247d-4aee-8483-afb1398759c4-kube-api-access-ljdt2\") pod \"cert-manager-webhook-6486ffd997-5dkzd\" (UID: \"2f213863-247d-4aee-8483-afb1398759c4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:58.003276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.003234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:58.038942 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.038905 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:07:58.131343 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.131299 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:58.178084 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.178054 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5dkzd"] Jul 08 16:07:58.181520 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:07:58.181490 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f213863_247d_4aee_8483_afb1398759c4.slice/crio-ecebba08be7ca9443eed8c387da6dce3fdf91fa9bbd328e32d242c57e505af4c WatchSource:0}: Error finding container ecebba08be7ca9443eed8c387da6dce3fdf91fa9bbd328e32d242c57e505af4c: Status 404 returned error can't find the container with id ecebba08be7ca9443eed8c387da6dce3fdf91fa9bbd328e32d242c57e505af4c Jul 08 16:07:58.575689 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.575600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" event={"ID":"2f213863-247d-4aee-8483-afb1398759c4","Type":"ContainerStarted","Data":"ecebba08be7ca9443eed8c387da6dce3fdf91fa9bbd328e32d242c57e505af4c"} Jul 08 16:07:58.771963 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.771928 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x"] Jul 08 16:07:58.776565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.776542 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.779405 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.779383 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:07:58.779517 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.779417 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:07:58.780678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.780664 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqd4t\"" Jul 08 16:07:58.795521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.795488 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x"] Jul 08 16:07:58.816859 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.816828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.816859 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.816861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.817089 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.816882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjxj\" (UniqueName: \"kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.918316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.918230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.918316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.918264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.918316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.918283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjxj\" (UniqueName: \"kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.918640 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.918617 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.918675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.918627 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:58.928977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:58.928946 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjxj\" (UniqueName: \"kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:59.086199 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.086161 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:07:59.259172 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.259128 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x"] Jul 08 16:07:59.261141 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:07:59.261109 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94ff66b_952d_43aa_9211_105340fa9f8a.slice/crio-c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b WatchSource:0}: Error finding container c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b: Status 404 returned error can't find the container with id c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b Jul 08 16:07:59.584296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.584208 2572 generic.go:356] "Generic (PLEG): container finished" podID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerID="5d19dc6d694c07893df34205f2a79f09e5637d26e2ab64858f06e21839d65471" exitCode=0 Jul 08 16:07:59.584296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.584266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" event={"ID":"d94ff66b-952d-43aa-9211-105340fa9f8a","Type":"ContainerDied","Data":"5d19dc6d694c07893df34205f2a79f09e5637d26e2ab64858f06e21839d65471"} Jul 08 16:07:59.584805 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.584311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" event={"ID":"d94ff66b-952d-43aa-9211-105340fa9f8a","Type":"ContainerStarted","Data":"c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b"} Jul 08 16:07:59.822993 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.822953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:59.999138 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:07:59.999103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:01.599375 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:01.599331 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" event={"ID":"2f213863-247d-4aee-8483-afb1398759c4","Type":"ContainerStarted","Data":"68523ed440949a1f80856efd57af7e5d148ce4e2097286041d75dcaf7786d6d4"} Jul 08 16:08:01.599830 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:01.599432 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:08:01.617340 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:01.617281 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" podStartSLOduration=1.68155868 podStartE2EDuration="4.617264336s" totalImagesPullingTime="2.935705656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:01.61564618 +0000 UTC m=+253.197518750" watchObservedRunningTime="2026-07-08 16:08:01.617264336 +0000 UTC m=+253.199136847" Jul 08 16:08:02.901149 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:02.901111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:03.003940 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:03.003894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:03.471906 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:03.471868 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94ff66b_952d_43aa_9211_105340fa9f8a.slice/crio-conmon-118142f1f8fce4efa4746c29121ded74b4b80ba9afb0e0322a000b0bf7fc9756.scope\": RecentStats: unable to find data in memory cache]" Jul 08 16:08:03.472054 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:03.471912 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd94ff66b_952d_43aa_9211_105340fa9f8a.slice/crio-conmon-118142f1f8fce4efa4746c29121ded74b4b80ba9afb0e0322a000b0bf7fc9756.scope\": RecentStats: unable to find data in memory cache]" Jul 08 16:08:03.610620 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:03.610536 2572 generic.go:356] "Generic (PLEG): container finished" podID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerID="118142f1f8fce4efa4746c29121ded74b4b80ba9afb0e0322a000b0bf7fc9756" exitCode=0 Jul 08 16:08:03.610620 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:03.610610 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" event={"ID":"d94ff66b-952d-43aa-9211-105340fa9f8a","Type":"ContainerDied","Data":"118142f1f8fce4efa4746c29121ded74b4b80ba9afb0e0322a000b0bf7fc9756"} Jul 08 16:08:04.616905 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:04.616870 2572 generic.go:356] "Generic (PLEG): container finished" podID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerID="453560ef96b64f516cf97518cb1139d512356af6a16e297c73dab9d769d81c6b" exitCode=0 Jul 08 16:08:04.617304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:04.616916 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" event={"ID":"d94ff66b-952d-43aa-9211-105340fa9f8a","Type":"ContainerDied","Data":"453560ef96b64f516cf97518cb1139d512356af6a16e297c73dab9d769d81c6b"} Jul 08 16:08:05.744247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.744222 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:08:05.767982 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.767950 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q"] Jul 08 16:08:05.768308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768285 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="extract" Jul 08 16:08:05.768308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768303 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="extract" Jul 08 16:08:05.768308 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768314 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="pull" Jul 08 16:08:05.768539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768322 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="pull" Jul 08 16:08:05.768539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768345 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="util" Jul 08 16:08:05.768539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768352 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="util" Jul 08 16:08:05.768539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.768428 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94ff66b-952d-43aa-9211-105340fa9f8a" containerName="extract" Jul 08 16:08:05.772522 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.772500 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.775224 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.775206 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-jzqds\"" Jul 08 16:08:05.782020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.781993 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q"] Jul 08 16:08:05.879010 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.878929 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle\") pod \"d94ff66b-952d-43aa-9211-105340fa9f8a\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " Jul 08 16:08:05.879010 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.878975 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util\") pod \"d94ff66b-952d-43aa-9211-105340fa9f8a\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " Jul 08 16:08:05.879010 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.879001 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcjxj\" (UniqueName: \"kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj\") pod \"d94ff66b-952d-43aa-9211-105340fa9f8a\" (UID: \"d94ff66b-952d-43aa-9211-105340fa9f8a\") " Jul 08 16:08:05.879296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.879115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phdll\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-kube-api-access-phdll\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.879296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.879179 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.879445 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.879415 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle" (OuterVolumeSpecName: "bundle") pod "d94ff66b-952d-43aa-9211-105340fa9f8a" (UID: "d94ff66b-952d-43aa-9211-105340fa9f8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:08:05.881304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.881277 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj" (OuterVolumeSpecName: "kube-api-access-zcjxj") pod "d94ff66b-952d-43aa-9211-105340fa9f8a" (UID: "d94ff66b-952d-43aa-9211-105340fa9f8a"). InnerVolumeSpecName "kube-api-access-zcjxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:08:05.883638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.883600 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util" (OuterVolumeSpecName: "util") pod "d94ff66b-952d-43aa-9211-105340fa9f8a" (UID: "d94ff66b-952d-43aa-9211-105340fa9f8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:08:05.979768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.979732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.979952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.979784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phdll\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-kube-api-access-phdll\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.979952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.979824 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:05.979952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.979835 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d94ff66b-952d-43aa-9211-105340fa9f8a-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:05.979952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.979843 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcjxj\" (UniqueName: \"kubernetes.io/projected/d94ff66b-952d-43aa-9211-105340fa9f8a-kube-api-access-zcjxj\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:05.992214 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.988802 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:05.992214 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:05.989090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phdll\" (UniqueName: \"kubernetes.io/projected/b1823f57-b9ec-453a-834f-d025a62f70e3-kube-api-access-phdll\") pod \"cert-manager-cainjector-559cdd8c87-7rq7q\" (UID: \"b1823f57-b9ec-453a-834f-d025a62f70e3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:06.082753 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.082701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" Jul 08 16:08:06.213367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.213258 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q"] Jul 08 16:08:06.215875 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:06.215832 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1823f57_b9ec_453a_834f_d025a62f70e3.slice/crio-ecacb78498af10715c6a1f64b69272d741f4f42d9c53225d1a67a5ea71dfe35e WatchSource:0}: Error finding container ecacb78498af10715c6a1f64b69272d741f4f42d9c53225d1a67a5ea71dfe35e: Status 404 returned error can't find the container with id ecacb78498af10715c6a1f64b69272d741f4f42d9c53225d1a67a5ea71dfe35e Jul 08 16:08:06.628395 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.628355 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" event={"ID":"d94ff66b-952d-43aa-9211-105340fa9f8a","Type":"ContainerDied","Data":"c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b"} Jul 08 16:08:06.628395 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.628380 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz462x" Jul 08 16:08:06.628644 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.628417 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c86dc6ee10ceedc9b0d2efe8b5309ca1bb408170f4cbf42fa974276b81ea259b" Jul 08 16:08:06.629920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.629887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" event={"ID":"b1823f57-b9ec-453a-834f-d025a62f70e3","Type":"ContainerStarted","Data":"3d3cf5595fa423693a5f2b6381fb7b399a3d3af2c2c38ba5a2d942d1b7bd355b"} Jul 08 16:08:06.630012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.629926 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" event={"ID":"b1823f57-b9ec-453a-834f-d025a62f70e3","Type":"ContainerStarted","Data":"ecacb78498af10715c6a1f64b69272d741f4f42d9c53225d1a67a5ea71dfe35e"} Jul 08 16:08:06.647212 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.647162 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7rq7q" podStartSLOduration=1.647146376 podStartE2EDuration="1.647146376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:06.645771236 +0000 UTC m=+258.227643747" watchObservedRunningTime="2026-07-08 16:08:06.647146376 +0000 UTC m=+258.229018866" Jul 08 16:08:06.996937 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:06.996904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:07.097877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:07.097824 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:07.607321 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:07.607289 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5dkzd" Jul 08 16:08:08.207706 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:08.207675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:08.866710 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:08.866675 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7g2sr"] Jul 08 16:08:08.870419 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:08.870403 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:08.873226 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:08.873204 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2kl5f\"" Jul 08 16:08:08.879900 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:08.879880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7g2sr"] Jul 08 16:08:09.003293 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.003253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-bound-sa-token\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.003474 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.003360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxhzl\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-kube-api-access-pxhzl\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.104170 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.104133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxhzl\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-kube-api-access-pxhzl\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.104325 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.104197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-bound-sa-token\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.113147 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.113113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-bound-sa-token\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.113283 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.113205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxhzl\" (UniqueName: \"kubernetes.io/projected/bcb7c876-7dfc-4332-9cd0-4b5ad112dad1-kube-api-access-pxhzl\") pod \"cert-manager-55b4d954d5-7g2sr\" (UID: \"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1\") " pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.180193 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.180163 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7g2sr" Jul 08 16:08:09.312982 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.312953 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7g2sr"] Jul 08 16:08:09.315480 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:09.315452 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcb7c876_7dfc_4332_9cd0_4b5ad112dad1.slice/crio-b977d824fc1543d1244247bca0ad6fe22540093d7f9c9c16a4065fd2e984d1f7 WatchSource:0}: Error finding container b977d824fc1543d1244247bca0ad6fe22540093d7f9c9c16a4065fd2e984d1f7: Status 404 returned error can't find the container with id b977d824fc1543d1244247bca0ad6fe22540093d7f9c9c16a4065fd2e984d1f7 Jul 08 16:08:09.644518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.644429 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7g2sr" event={"ID":"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1","Type":"ContainerStarted","Data":"032be173e14cdb3fae3d45adbdd13908d9b1ccc5a97046d39d78e1915c5ffbc9"} Jul 08 16:08:09.644518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.644469 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7g2sr" event={"ID":"bcb7c876-7dfc-4332-9cd0-4b5ad112dad1","Type":"ContainerStarted","Data":"b977d824fc1543d1244247bca0ad6fe22540093d7f9c9c16a4065fd2e984d1f7"} Jul 08 16:08:09.661617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:09.661571 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7g2sr" podStartSLOduration=1.661556106 podStartE2EDuration="1.661556106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:09.660920936 +0000 UTC m=+261.242793448" watchObservedRunningTime="2026-07-08 16:08:09.661556106 +0000 UTC m=+261.243428617" Jul 08 16:08:10.995228 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:10.995129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:11.118176 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:11.118126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:16.375693 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:16.375655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:16.471574 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:16.471537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:18.090275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.090241 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:18.210127 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.210093 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s"] Jul 08 16:08:18.214363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.214343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.217241 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.217210 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:08:18.217354 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.217240 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqd4t\"" Jul 08 16:08:18.218243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.218226 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:08:18.222638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.222616 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s"] Jul 08 16:08:18.284635 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.284594 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.284831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.284659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srtmt\" (UniqueName: \"kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.284831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.284778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.385687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.385595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srtmt\" (UniqueName: \"kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.385687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.385656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.385687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.385687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.386009 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.385994 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.386110 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.386092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.394785 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.394752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srtmt\" (UniqueName: \"kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.524985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.524949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:18.657236 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.657210 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s"] Jul 08 16:08:18.659742 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:18.659717 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1aaf165_1cf3_4ff2_8ec5_d263c99bd483.slice/crio-b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653 WatchSource:0}: Error finding container b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653: Status 404 returned error can't find the container with id b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653 Jul 08 16:08:18.685843 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:18.685810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" event={"ID":"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483","Type":"ContainerStarted","Data":"b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653"} Jul 08 16:08:19.691954 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:19.691920 2572 generic.go:356] "Generic (PLEG): container finished" podID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerID="42f77674fd1c8cb124d3b154c829fa577219c07fb60daf1d0aa6a82d23c27e04" exitCode=0 Jul 08 16:08:19.692416 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:19.692018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" event={"ID":"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483","Type":"ContainerDied","Data":"42f77674fd1c8cb124d3b154c829fa577219c07fb60daf1d0aa6a82d23c27e04"} Jul 08 16:08:20.698087 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:20.698056 2572 generic.go:356] "Generic (PLEG): container finished" podID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerID="22183315cc54ee2089c23c561b0e7d41941b97cdd04a8b06eb8a5a990155ef88" exitCode=0 Jul 08 16:08:20.698444 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:20.698121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" event={"ID":"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483","Type":"ContainerDied","Data":"22183315cc54ee2089c23c561b0e7d41941b97cdd04a8b06eb8a5a990155ef88"} Jul 08 16:08:21.705462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:21.705425 2572 generic.go:356] "Generic (PLEG): container finished" podID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerID="0445da57bb87f932dbb9bec8281c26bf70ec198079f2a702feb556e1fd72b0cc" exitCode=0 Jul 08 16:08:21.705859 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:21.705513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" event={"ID":"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483","Type":"ContainerDied","Data":"0445da57bb87f932dbb9bec8281c26bf70ec198079f2a702feb556e1fd72b0cc"} Jul 08 16:08:22.839511 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.839487 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:22.925603 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.925566 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srtmt\" (UniqueName: \"kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt\") pod \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " Jul 08 16:08:22.925803 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.925688 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle\") pod \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " Jul 08 16:08:22.925803 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.925796 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util\") pod \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\" (UID: \"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483\") " Jul 08 16:08:22.926390 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.926362 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle" (OuterVolumeSpecName: "bundle") pod "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" (UID: "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:08:22.927676 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.927657 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt" (OuterVolumeSpecName: "kube-api-access-srtmt") pod "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" (UID: "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483"). InnerVolumeSpecName "kube-api-access-srtmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:08:22.931608 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:22.931585 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util" (OuterVolumeSpecName: "util") pod "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" (UID: "f1aaf165-1cf3-4ff2-8ec5-d263c99bd483"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:08:23.026855 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.026759 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:23.026855 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.026793 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:23.026855 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.026803 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srtmt\" (UniqueName: \"kubernetes.io/projected/f1aaf165-1cf3-4ff2-8ec5-d263c99bd483-kube-api-access-srtmt\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:08:23.717083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.717057 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" Jul 08 16:08:23.717083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.717054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afslv8s" event={"ID":"f1aaf165-1cf3-4ff2-8ec5-d263c99bd483","Type":"ContainerDied","Data":"b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653"} Jul 08 16:08:23.717289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:23.717114 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b891e98038ea85fe3689463ea582330693636764cb122402674fec060168a653" Jul 08 16:08:33.145697 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:33.145659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:34.220278 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220241 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv"] Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220529 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="util" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220540 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="util" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220549 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="pull" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220554 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="pull" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220561 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="extract" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220566 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="extract" Jul 08 16:08:34.220649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.220624 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1aaf165-1cf3-4ff2-8ec5-d263c99bd483" containerName="extract" Jul 08 16:08:34.223175 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.223154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.227604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.227579 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 16:08:34.227730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.227679 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 16:08:34.227812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.227750 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 16:08:34.228135 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.228118 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 16:08:34.228316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.228298 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gr2cb\"" Jul 08 16:08:34.240612 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.240588 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv"] Jul 08 16:08:34.327101 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.327056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.327101 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.327093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.327336 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.327115 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwhh9\" (UniqueName: \"kubernetes.io/projected/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-kube-api-access-rwhh9\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.327336 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.327171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.327336 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.327211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428410 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428410 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwhh9\" (UniqueName: \"kubernetes.io/projected/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-kube-api-access-rwhh9\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.428983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.428960 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-manifests\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.430779 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.430758 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-tmp\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.430877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.430836 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.430877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.430866 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.437891 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.437868 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwhh9\" (UniqueName: \"kubernetes.io/projected/a61a7be9-8de2-45ac-989a-c9c9ba32cfb3-kube-api-access-rwhh9\") pod \"opendatahub-operator-controller-manager-bf8d94745-bkdnv\" (UID: \"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3\") " pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.533934 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.533847 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:34.667739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.667615 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv"] Jul 08 16:08:34.670881 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:34.670840 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61a7be9_8de2_45ac_989a_c9c9ba32cfb3.slice/crio-e83101c64ed84c74b1551a0a510bffb2c32649a29c13630186091670620e745b WatchSource:0}: Error finding container e83101c64ed84c74b1551a0a510bffb2c32649a29c13630186091670620e745b: Status 404 returned error can't find the container with id e83101c64ed84c74b1551a0a510bffb2c32649a29c13630186091670620e745b Jul 08 16:08:34.766420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:34.766385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" event={"ID":"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3","Type":"ContainerStarted","Data":"e83101c64ed84c74b1551a0a510bffb2c32649a29c13630186091670620e745b"} Jul 08 16:08:35.782329 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:35.782284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:36.454997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:36.454953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:36.555714 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:36.555675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:37.782476 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:37.782442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" event={"ID":"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3","Type":"ContainerStarted","Data":"c88d33f5e90b35030678b3d8462b0afbbbbd3f6cfee44494b5c32e93644232c2"} Jul 08 16:08:39.792970 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:39.792936 2572 generic.go:356] "Generic (PLEG): container finished" podID="a61a7be9-8de2-45ac-989a-c9c9ba32cfb3" containerID="c88d33f5e90b35030678b3d8462b0afbbbbd3f6cfee44494b5c32e93644232c2" exitCode=0 Jul 08 16:08:39.793474 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:39.793011 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" event={"ID":"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3","Type":"ContainerDied","Data":"c88d33f5e90b35030678b3d8462b0afbbbbd3f6cfee44494b5c32e93644232c2"} Jul 08 16:08:40.798810 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:40.798775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" event={"ID":"a61a7be9-8de2-45ac-989a-c9c9ba32cfb3","Type":"ContainerStarted","Data":"702fab3334b6cead3a52a73d44a4286edd7df0ccead3ef4ee96e350b4468e03c"} Jul 08 16:08:40.799294 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:40.798983 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:40.822983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:40.822932 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" podStartSLOduration=2.392676159 podStartE2EDuration="6.822918906s" totalImagesPullingTime="3.366244577s" totalInitContainerRuntime="1.06399817s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:40.820749644 +0000 UTC m=+292.402622165" watchObservedRunningTime="2026-07-08 16:08:40.822918906 +0000 UTC m=+292.404791415" Jul 08 16:08:45.045467 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:45.045434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:45.148841 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:45.148809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:50.309832 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:50.309801 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:08:50.313012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:50.312993 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:08:50.315001 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:50.314980 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:08:51.805305 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:51.805275 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bf8d94745-bkdnv" Jul 08 16:08:54.537108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:54.537056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:54.705779 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:54.705747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.149788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.149752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.239895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.239855 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt"] Jul 08 16:08:55.245740 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.245708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.248710 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.248668 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 16:08:55.249002 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.248982 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 16:08:55.249951 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.249931 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-87kst\"" Jul 08 16:08:55.250266 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.250249 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 16:08:55.250355 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.250289 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 16:08:55.270104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.270070 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt"] Jul 08 16:08:55.292259 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.292222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-kube-api-access-kqdjk\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.292259 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.292257 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tmp\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.292517 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.292279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.393197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.393150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-kube-api-access-kqdjk\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.393197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.393200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tmp\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.393463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.393232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.393463 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:55.393414 2572 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 08 16:08:55.393564 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:55.393491 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs podName:7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7 nodeName:}" failed. No retries permitted until 2026-07-08 16:08:55.893471585 +0000 UTC m=+307.475344073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs") pod "kube-auth-proxy-6bddc7bb64-n62rt" (UID: "7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7") : secret "kube-auth-proxy-tls" not found Jul 08 16:08:55.395512 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.395488 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tmp\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.410268 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.410205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqdjk\" (UniqueName: \"kubernetes.io/projected/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-kube-api-access-kqdjk\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.420212 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.420171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.524261 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.524228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.617621 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.617588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.739915 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.739884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:55.897322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.897283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:55.899729 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:55.899695 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7-tls-certs\") pod \"kube-auth-proxy-6bddc7bb64-n62rt\" (UID: \"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7\") " pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:56.156118 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.155997 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" Jul 08 16:08:56.315589 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.315549 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt"] Jul 08 16:08:56.318694 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:56.318665 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc9b3f7_1a0e_43a4_b662_3863fcfc79c7.slice/crio-5ae9c63eff72ba2712d8509c5cdd701f0d0fb376aad12d182d7dcff7ce1faaaa WatchSource:0}: Error finding container 5ae9c63eff72ba2712d8509c5cdd701f0d0fb376aad12d182d7dcff7ce1faaaa: Status 404 returned error can't find the container with id 5ae9c63eff72ba2712d8509c5cdd701f0d0fb376aad12d182d7dcff7ce1faaaa Jul 08 16:08:56.321447 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.320679 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:08:56.335295 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.335271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:56.349674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.347235 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lw85p"] Jul 08 16:08:56.354886 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.354827 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.358096 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.358061 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 16:08:56.358227 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.358075 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jz8b2\"" Jul 08 16:08:56.361688 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.361653 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lw85p"] Jul 08 16:08:56.401869 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.401836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.402086 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.401893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z75fg\" (UniqueName: \"kubernetes.io/projected/50398117-5339-4dec-bb94-97f207e7059d-kube-api-access-z75fg\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.415996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.415916 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:08:56.419426 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.419400 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.419787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.419749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:56.421957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.421937 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w5x4s\"" Jul 08 16:08:56.422122 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.422106 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 16:08:56.422203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.422172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 16:08:56.422203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.422180 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 16:08:56.422298 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.422172 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 16:08:56.432169 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.432143 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:08:56.489761 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.489724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:56.503260 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503413 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503413 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.503413 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503383 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9w7\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503579 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:56.503463 2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 08 16:08:56.503579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z75fg\" (UniqueName: \"kubernetes.io/projected/50398117-5339-4dec-bb94-97f207e7059d-kube-api-access-z75fg\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.503579 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:08:56.503546 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs podName:50398117-5339-4dec-bb94-97f207e7059d nodeName:}" failed. No retries permitted until 2026-07-08 16:08:57.003525023 +0000 UTC m=+308.585397526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs") pod "model-serving-api-54d89bd5fc-lw85p" (UID: "50398117-5339-4dec-bb94-97f207e7059d") : secret "model-serving-api-tls" not found Jul 08 16:08:56.503784 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503784 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.503784 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.503703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.516244 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.516210 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z75fg\" (UniqueName: \"kubernetes.io/projected/50398117-5339-4dec-bb94-97f207e7059d-kube-api-access-z75fg\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:56.604652 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.604828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.604828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.604828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9w7\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.604828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604798 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.604828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.605116 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.604843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.605370 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.605337 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.607195 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.607143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.607290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.607207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.608090 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.608071 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.608181 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.608113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.613398 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.613375 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9w7\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.613557 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.613540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token\") pod \"istiod-openshift-gateway-7574459656-ln5lk\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.700808 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.700780 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:56.729326 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.729292 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:08:56.871211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.871181 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:08:56.872573 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:56.872547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" event={"ID":"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7","Type":"ContainerStarted","Data":"5ae9c63eff72ba2712d8509c5cdd701f0d0fb376aad12d182d7dcff7ce1faaaa"} Jul 08 16:08:56.873681 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:56.873659 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9dbb31_ad07_4aab_9459_5e44a6e6f2cf.slice/crio-77a1904145db2ae26e4be70921fbee3d585cf5623239f69d27584051f26de3bc WatchSource:0}: Error finding container 77a1904145db2ae26e4be70921fbee3d585cf5623239f69d27584051f26de3bc: Status 404 returned error can't find the container with id 77a1904145db2ae26e4be70921fbee3d585cf5623239f69d27584051f26de3bc Jul 08 16:08:57.008416 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.008312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:57.010624 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.010605 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50398117-5339-4dec-bb94-97f207e7059d-tls-certs\") pod \"model-serving-api-54d89bd5fc-lw85p\" (UID: \"50398117-5339-4dec-bb94-97f207e7059d\") " pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:57.267873 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.267787 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:08:57.404860 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.404819 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lw85p"] Jul 08 16:08:57.407837 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:08:57.407812 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50398117_5339_4dec_bb94_97f207e7059d.slice/crio-77b640c22fa4bc3c5c382908e446b7dbb82f03e10d141be4b84ab01607666937 WatchSource:0}: Error finding container 77b640c22fa4bc3c5c382908e446b7dbb82f03e10d141be4b84ab01607666937: Status 404 returned error can't find the container with id 77b640c22fa4bc3c5c382908e446b7dbb82f03e10d141be4b84ab01607666937 Jul 08 16:08:57.451840 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.451805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:57.879108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.879067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" event={"ID":"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf","Type":"ContainerStarted","Data":"77a1904145db2ae26e4be70921fbee3d585cf5623239f69d27584051f26de3bc"} Jul 08 16:08:57.880474 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:08:57.880448 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" event={"ID":"50398117-5339-4dec-bb94-97f207e7059d","Type":"ContainerStarted","Data":"77b640c22fa4bc3c5c382908e446b7dbb82f03e10d141be4b84ab01607666937"} Jul 08 16:09:00.897457 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:00.897412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" event={"ID":"7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7","Type":"ContainerStarted","Data":"57c581c9dc1cfe5c812e0f6bb20145dccd7701737f022e76114f2b06eaf60903"} Jul 08 16:09:00.898936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:00.898912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" event={"ID":"50398117-5339-4dec-bb94-97f207e7059d","Type":"ContainerStarted","Data":"8f0263baf384e6ece2680eefb241bc89c1ce707df7f83488522eed86f0cd9c51"} Jul 08 16:09:00.899071 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:00.899029 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:09:00.919400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:00.919352 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bddc7bb64-n62rt" podStartSLOduration=2.096366324 podStartE2EDuration="5.919336298s" totalImagesPullingTime="3.822969974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:00.918188146 +0000 UTC m=+312.500060658" watchObservedRunningTime="2026-07-08 16:09:00.919336298 +0000 UTC m=+312.501208808" Jul 08 16:09:00.939705 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:00.939648 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" podStartSLOduration=2.254092363 podStartE2EDuration="4.939634138s" totalImagesPullingTime="2.685541775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:00.937901542 +0000 UTC m=+312.519774096" watchObservedRunningTime="2026-07-08 16:09:00.939634138 +0000 UTC m=+312.521506649" Jul 08 16:09:02.813307 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:02.813269 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:09:02.813559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:02.813339 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:09:02.910838 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:02.910799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" event={"ID":"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf","Type":"ContainerStarted","Data":"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624"} Jul 08 16:09:02.911017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:02.910869 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:09:02.937625 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:02.937574 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" podStartSLOduration=1.00007813 podStartE2EDuration="6.937548853s" totalImagesPullingTime="5.937470723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:02.935177397 +0000 UTC m=+314.517049930" watchObservedRunningTime="2026-07-08 16:09:02.937548853 +0000 UTC m=+314.519421364" Jul 08 16:09:03.584590 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.584552 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:03.700603 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.700557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:03.918650 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.918558 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:09:03.934595 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.934557 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6"] Jul 08 16:09:03.937936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.937913 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.940754 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.940735 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wc5t5\"" Jul 08 16:09:03.959539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.959503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6"] Jul 08 16:09:03.977482 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nddlb\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-kube-api-access-nddlb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977504 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977559 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d8c70df-7396-4b64-a170-03c687246582-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d8c70df-7396-4b64-a170-03c687246582-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977928 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:03.977928 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:03.977697 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.003724 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.003692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:04.078281 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078281 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d8c70df-7396-4b64-a170-03c687246582-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d8c70df-7396-4b64-a170-03c687246582-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078507 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078794 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nddlb\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-kube-api-access-nddlb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078794 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078747 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078893 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078820 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.078957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.078934 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.079026 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.079011 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.079214 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.079195 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d8c70df-7396-4b64-a170-03c687246582-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.080769 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.080750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d8c70df-7396-4b64-a170-03c687246582-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.080861 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.080819 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d8c70df-7396-4b64-a170-03c687246582-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.086564 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.086540 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.086719 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.086698 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nddlb\" (UniqueName: \"kubernetes.io/projected/6d8c70df-7396-4b64-a170-03c687246582-kube-api-access-nddlb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4q6nk6\" (UID: \"6d8c70df-7396-4b64-a170-03c687246582\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.250664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.250630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:04.423634 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.423599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:04.430788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.430753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6"] Jul 08 16:09:04.433687 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:09:04.433660 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8c70df_7396_4b64_a170_03c687246582.slice/crio-1e731fb84157a5af67e088e1c89627e2113207881cb5a1e9124f9f7df4107c5b WatchSource:0}: Error finding container 1e731fb84157a5af67e088e1c89627e2113207881cb5a1e9124f9f7df4107c5b: Status 404 returned error can't find the container with id 1e731fb84157a5af67e088e1c89627e2113207881cb5a1e9124f9f7df4107c5b Jul 08 16:09:04.523608 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.523509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:04.922334 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:04.922306 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" event={"ID":"6d8c70df-7396-4b64-a170-03c687246582","Type":"ContainerStarted","Data":"1e731fb84157a5af67e088e1c89627e2113207881cb5a1e9124f9f7df4107c5b"} Jul 08 16:09:05.330673 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.330578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:05.463141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.463097 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t"] Jul 08 16:09:05.467834 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.467811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.475431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.475364 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 16:09:05.478598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.478578 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fkcvg\"" Jul 08 16:09:05.486497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.486467 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp"] Jul 08 16:09:05.493720 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.493695 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.495967 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.495944 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t"] Jul 08 16:09:05.499335 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.499313 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dw6c2\"" Jul 08 16:09:05.499500 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.499390 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 16:09:05.530931 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.530895 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:05.537307 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.537278 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp"] Jul 08 16:09:05.594243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.594162 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f72c389-d719-4210-bda7-48546c426b20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.594243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.594194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmzqt\" (UniqueName: \"kubernetes.io/projected/3f72c389-d719-4210-bda7-48546c426b20-kube-api-access-hmzqt\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.594243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.594219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b737ed2d-8478-4c3b-be80-a1e116da26a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.594456 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.594296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87hrf\" (UniqueName: \"kubernetes.io/projected/b737ed2d-8478-4c3b-be80-a1e116da26a0-kube-api-access-87hrf\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.646904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.646870 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:05.695322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.695286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f72c389-d719-4210-bda7-48546c426b20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.695322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.695328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmzqt\" (UniqueName: \"kubernetes.io/projected/3f72c389-d719-4210-bda7-48546c426b20-kube-api-access-hmzqt\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.695572 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.695353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b737ed2d-8478-4c3b-be80-a1e116da26a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.695572 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.695405 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87hrf\" (UniqueName: \"kubernetes.io/projected/b737ed2d-8478-4c3b-be80-a1e116da26a0-kube-api-access-87hrf\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.698514 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.698484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f72c389-d719-4210-bda7-48546c426b20-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.698643 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.698484 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b737ed2d-8478-4c3b-be80-a1e116da26a0-cert\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.710277 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.710246 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87hrf\" (UniqueName: \"kubernetes.io/projected/b737ed2d-8478-4c3b-be80-a1e116da26a0-kube-api-access-87hrf\") pod \"kserve-controller-manager-d6f4b65b8-mvk7t\" (UID: \"b737ed2d-8478-4c3b-be80-a1e116da26a0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.710542 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.710512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmzqt\" (UniqueName: \"kubernetes.io/projected/3f72c389-d719-4210-bda7-48546c426b20-kube-api-access-hmzqt\") pod \"llmisvc-controller-manager-777c6bd7d5-9b7qp\" (UID: \"3f72c389-d719-4210-bda7-48546c426b20\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.751687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.751633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:05.779414 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.779377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:05.816721 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.816678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:05.891692 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.891631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:05.968244 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:05.968204 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t"] Jul 08 16:09:05.971687 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:09:05.971662 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb737ed2d_8478_4c3b_be80_a1e116da26a0.slice/crio-a78fdb3e7b795cbc6fe4ac98cc5411e0673a100569f289ad72189ebcadda35f0 WatchSource:0}: Error finding container a78fdb3e7b795cbc6fe4ac98cc5411e0673a100569f289ad72189ebcadda35f0: Status 404 returned error can't find the container with id a78fdb3e7b795cbc6fe4ac98cc5411e0673a100569f289ad72189ebcadda35f0 Jul 08 16:09:06.014953 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:06.014926 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp"] Jul 08 16:09:06.016675 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:09:06.016647 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f72c389_d719_4210_bda7_48546c426b20.slice/crio-a0e276c6fea6410fe4d88e1a8f5f248bf3e6d2985abdddf3ab65fa9bd9941641 WatchSource:0}: Error finding container a0e276c6fea6410fe4d88e1a8f5f248bf3e6d2985abdddf3ab65fa9bd9941641: Status 404 returned error can't find the container with id a0e276c6fea6410fe4d88e1a8f5f248bf3e6d2985abdddf3ab65fa9bd9941641 Jul 08 16:09:06.938164 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:06.938120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" event={"ID":"3f72c389-d719-4210-bda7-48546c426b20","Type":"ContainerStarted","Data":"a0e276c6fea6410fe4d88e1a8f5f248bf3e6d2985abdddf3ab65fa9bd9941641"} Jul 08 16:09:06.940080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:06.939984 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" event={"ID":"b737ed2d-8478-4c3b-be80-a1e116da26a0","Type":"ContainerStarted","Data":"a78fdb3e7b795cbc6fe4ac98cc5411e0673a100569f289ad72189ebcadda35f0"} Jul 08 16:09:07.974730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:07.974698 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:09:07.975141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:07.974895 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" podUID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" containerName="discovery" containerID="cri-o://1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624" gracePeriod=30 Jul 08 16:09:08.075234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.075186 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:09:08.075380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.075265 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:09:08.075380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.075294 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:09:08.295901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.295873 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:09:08.423093 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423055 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs9w7\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423128 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423187 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423252 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423301 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423343 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.423409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.423368 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig\") pod \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\" (UID: \"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf\") " Jul 08 16:09:08.424238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.424201 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:09:08.426192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.426136 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs" (OuterVolumeSpecName: "local-certs") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:09:08.426290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.426202 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:09:08.426504 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.426477 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7" (OuterVolumeSpecName: "kube-api-access-cs9w7") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "kube-api-access-cs9w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:09:08.426778 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.426749 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:09:08.426967 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.426940 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:09:08.427060 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.427013 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts" (OuterVolumeSpecName: "cacerts") pod "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" (UID: "6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:09:08.524305 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524279 2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-local-certs\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524309 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-token\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524325 2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-ca-configmap\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524339 2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-kubeconfig\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524352 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs9w7\" (UniqueName: \"kubernetes.io/projected/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-kube-api-access-cs9w7\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524364 2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-cacerts\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.524400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.524376 2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf-istio-csr-dns-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:09:08.951988 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.951944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" event={"ID":"6d8c70df-7396-4b64-a170-03c687246582","Type":"ContainerStarted","Data":"1e0cdade8225d642d5ef0abace0176ea4bdc7be9941d3a42fb9a467b96ea987e"} Jul 08 16:09:08.953445 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.953417 2572 generic.go:356] "Generic (PLEG): container finished" podID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" containerID="1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624" exitCode=0 Jul 08 16:09:08.953576 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.953465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" event={"ID":"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf","Type":"ContainerDied","Data":"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624"} Jul 08 16:09:08.953576 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.953478 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" Jul 08 16:09:08.953576 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.953497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk" event={"ID":"6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf","Type":"ContainerDied","Data":"77a1904145db2ae26e4be70921fbee3d585cf5623239f69d27584051f26de3bc"} Jul 08 16:09:08.953576 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.953522 2572 scope.go:117] "RemoveContainer" containerID="1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624" Jul 08 16:09:08.963174 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.963151 2572 scope.go:117] "RemoveContainer" containerID="1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624" Jul 08 16:09:08.963498 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:09:08.963474 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624\": container with ID starting with 1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624 not found: ID does not exist" containerID="1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624" Jul 08 16:09:08.963562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.963508 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624"} err="failed to get container status \"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624\": rpc error: code = NotFound desc = could not find container \"1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624\": container with ID starting with 1ea60019f0f8b07514ccf72fa9165e6cf9e86a8c8394098e5d926707be6f9624 not found: ID does not exist" Jul 08 16:09:08.980327 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.980278 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" podStartSLOduration=2.3410645150000002 podStartE2EDuration="5.980260386s" totalImagesPullingTime="3.639195871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:08.979093736 +0000 UTC m=+320.560966269" watchObservedRunningTime="2026-07-08 16:09:08.980260386 +0000 UTC m=+320.562132903" Jul 08 16:09:08.998613 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:08.998577 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:09:09.005187 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:09.005153 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ln5lk"] Jul 08 16:09:09.251992 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:09.251896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:09.257231 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:09.257203 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:09.959440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:09.959411 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:09.960382 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:09.960363 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4q6nk6" Jul 08 16:09:10.473059 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:10.472979 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" path="/var/lib/kubelet/pods/6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf/volumes" Jul 08 16:09:11.908831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.908747 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lw85p" Jul 08 16:09:11.971248 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.971211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" event={"ID":"3f72c389-d719-4210-bda7-48546c426b20","Type":"ContainerStarted","Data":"26d1641ad7c983af720fc963116d439185f0a51971fc28ffedd019b216e483f5"} Jul 08 16:09:11.971407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.971310 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:11.972748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.972717 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" event={"ID":"b737ed2d-8478-4c3b-be80-a1e116da26a0","Type":"ContainerStarted","Data":"d968c46ea46fb8dab7365ee3c186b40b3d3e59809ff1bed19a69e267546c91cf"} Jul 08 16:09:11.972853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.972788 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:11.993141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:11.993094 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" podStartSLOduration=1.580675504 podStartE2EDuration="6.993074432s" totalImagesPullingTime="5.412398928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:11.992171753 +0000 UTC m=+323.574044288" watchObservedRunningTime="2026-07-08 16:09:11.993074432 +0000 UTC m=+323.574946940" Jul 08 16:09:12.010257 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:12.010209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" podStartSLOduration=1.5508458090000001 podStartE2EDuration="7.010193442s" totalImagesPullingTime="5.459347633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:12.009930051 +0000 UTC m=+323.591802560" watchObservedRunningTime="2026-07-08 16:09:12.010193442 +0000 UTC m=+323.592065952" Jul 08 16:09:42.980106 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:42.980009 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9b7qp" Jul 08 16:09:42.983290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:42.983265 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mvk7t" Jul 08 16:09:55.124173 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:55.124113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:55.180615 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:55.180582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:56.102824 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.102786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:56.194709 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.194675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:56.222795 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.222758 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:09:56.223116 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.223103 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" containerName="discovery" Jul 08 16:09:56.223186 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.223117 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" containerName="discovery" Jul 08 16:09:56.223228 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.223191 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9dbb31-ad07-4aab-9459-5e44a6e6f2cf" containerName="discovery" Jul 08 16:09:56.227404 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.227375 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:09:56.230184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.230158 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 16:09:56.230371 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.230250 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 16:09:56.231547 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.231522 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kdjn5\"" Jul 08 16:09:56.234598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.234531 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:09:56.345778 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.345744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g827h\" (UniqueName: \"kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h\") pod \"kuadrant-operator-catalog-b75lq\" (UID: \"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1\") " pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:09:56.446741 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.446701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g827h\" (UniqueName: \"kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h\") pod \"kuadrant-operator-catalog-b75lq\" (UID: \"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1\") " pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:09:56.461049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.461010 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g827h\" (UniqueName: \"kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h\") pod \"kuadrant-operator-catalog-b75lq\" (UID: \"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1\") " pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:09:56.539740 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.539692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:09:56.581431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.581396 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:09:56.677277 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.677235 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:09:56.679672 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:09:56.679642 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3c5dbb_2c90_46f0_be28_73cc00a9c3f1.slice/crio-a4b1c73ba495a9c0378654c30271042a7da2208c71d58e32963c7c990f78a426 WatchSource:0}: Error finding container a4b1c73ba495a9c0378654c30271042a7da2208c71d58e32963c7c990f78a426: Status 404 returned error can't find the container with id a4b1c73ba495a9c0378654c30271042a7da2208c71d58e32963c7c990f78a426 Jul 08 16:09:56.700553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.700458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:56.791707 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.791670 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tss9g"] Jul 08 16:09:56.796155 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.796133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:09:56.803704 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.803675 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tss9g"] Jul 08 16:09:56.850666 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.850624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5bcb\" (UniqueName: \"kubernetes.io/projected/9cb1a665-c0f0-455a-9dc6-8f409e1183ee-kube-api-access-z5bcb\") pod \"kuadrant-operator-catalog-tss9g\" (UID: \"9cb1a665-c0f0-455a-9dc6-8f409e1183ee\") " pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:09:56.952176 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.952078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5bcb\" (UniqueName: \"kubernetes.io/projected/9cb1a665-c0f0-455a-9dc6-8f409e1183ee-kube-api-access-z5bcb\") pod \"kuadrant-operator-catalog-tss9g\" (UID: \"9cb1a665-c0f0-455a-9dc6-8f409e1183ee\") " pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:09:56.962283 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:56.962256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5bcb\" (UniqueName: \"kubernetes.io/projected/9cb1a665-c0f0-455a-9dc6-8f409e1183ee-kube-api-access-z5bcb\") pod \"kuadrant-operator-catalog-tss9g\" (UID: \"9cb1a665-c0f0-455a-9dc6-8f409e1183ee\") " pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:09:57.032696 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:57.032652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:57.106705 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:57.106672 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:09:57.192012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:57.191976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" event={"ID":"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1","Type":"ContainerStarted","Data":"a4b1c73ba495a9c0378654c30271042a7da2208c71d58e32963c7c990f78a426"} Jul 08 16:09:57.220404 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:57.220254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:09:57.257425 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:57.257338 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tss9g"] Jul 08 16:09:57.304552 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:09:57.304517 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb1a665_c0f0_455a_9dc6_8f409e1183ee.slice/crio-5f406c6edebd537f076c20e8b48055d7fb8a3187d36f4f8e252ed683ceba9d5a WatchSource:0}: Error finding container 5f406c6edebd537f076c20e8b48055d7fb8a3187d36f4f8e252ed683ceba9d5a: Status 404 returned error can't find the container with id 5f406c6edebd537f076c20e8b48055d7fb8a3187d36f4f8e252ed683ceba9d5a Jul 08 16:09:58.197748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:09:58.197709 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" event={"ID":"9cb1a665-c0f0-455a-9dc6-8f409e1183ee","Type":"ContainerStarted","Data":"5f406c6edebd537f076c20e8b48055d7fb8a3187d36f4f8e252ed683ceba9d5a"} Jul 08 16:10:00.213957 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.213905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" event={"ID":"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1","Type":"ContainerStarted","Data":"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456"} Jul 08 16:10:00.214471 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.213952 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" podUID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" containerName="registry-server" containerID="cri-o://97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456" gracePeriod=2 Jul 08 16:10:00.215350 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.215323 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" event={"ID":"9cb1a665-c0f0-455a-9dc6-8f409e1183ee","Type":"ContainerStarted","Data":"e19ecd4a99633ea231e69cc7b4f304ad5f12a1922d2aecc7190dbc0e657a4816"} Jul 08 16:10:00.233907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.233852 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" podStartSLOduration=1.482190866 podStartE2EDuration="4.233833362s" totalImagesPullingTime="2.751642496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:00.231490395 +0000 UTC m=+371.813362905" watchObservedRunningTime="2026-07-08 16:10:00.233833362 +0000 UTC m=+371.815705873" Jul 08 16:10:00.252709 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.252658 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" podStartSLOduration=2.123568234 podStartE2EDuration="4.252641349s" totalImagesPullingTime="2.129073115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:09:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:00.251388045 +0000 UTC m=+371.833260573" watchObservedRunningTime="2026-07-08 16:10:00.252641349 +0000 UTC m=+371.834513860" Jul 08 16:10:00.463856 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.463830 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:10:00.588098 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.587994 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g827h\" (UniqueName: \"kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h\") pod \"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1\" (UID: \"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1\") " Jul 08 16:10:00.590254 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.590230 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h" (OuterVolumeSpecName: "kube-api-access-g827h") pod "fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" (UID: "fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1"). InnerVolumeSpecName "kube-api-access-g827h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:10:00.689514 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:00.689472 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g827h\" (UniqueName: \"kubernetes.io/projected/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1-kube-api-access-g827h\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:01.221289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.221255 2572 generic.go:356] "Generic (PLEG): container finished" podID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" containerID="97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456" exitCode=0 Jul 08 16:10:01.221695 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.221301 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" Jul 08 16:10:01.221695 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.221341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" event={"ID":"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1","Type":"ContainerDied","Data":"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456"} Jul 08 16:10:01.221695 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.221388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b75lq" event={"ID":"fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1","Type":"ContainerDied","Data":"a4b1c73ba495a9c0378654c30271042a7da2208c71d58e32963c7c990f78a426"} Jul 08 16:10:01.221695 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.221410 2572 scope.go:117] "RemoveContainer" containerID="97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456" Jul 08 16:10:01.231204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.231186 2572 scope.go:117] "RemoveContainer" containerID="97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456" Jul 08 16:10:01.231527 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:10:01.231493 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456\": container with ID starting with 97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456 not found: ID does not exist" containerID="97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456" Jul 08 16:10:01.231606 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.231535 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456"} err="failed to get container status \"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456\": rpc error: code = NotFound desc = could not find container \"97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456\": container with ID starting with 97b18c3e4f2f6f27843912f65facd54eaa197aeb02e3077263092b1f43568456 not found: ID does not exist" Jul 08 16:10:01.249817 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.249781 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:10:01.255478 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:01.255451 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b75lq"] Jul 08 16:10:02.475002 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:02.474969 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" path="/var/lib/kubelet/pods/fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1/volumes" Jul 08 16:10:07.107558 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:07.107523 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:10:07.107976 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:07.107589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:10:07.130767 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:07.130735 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:10:07.276202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:07.276167 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tss9g" Jul 08 16:10:11.634778 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.634741 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc"] Jul 08 16:10:11.635222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.635199 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" containerName="registry-server" Jul 08 16:10:11.635222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.635215 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" containerName="registry-server" Jul 08 16:10:11.635297 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.635272 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa3c5dbb-2c90-46f0-be28-73cc00a9c3f1" containerName="registry-server" Jul 08 16:10:11.638428 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.638410 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.641614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.641597 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hbtxw\"" Jul 08 16:10:11.649202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.649173 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc"] Jul 08 16:10:11.780393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.780355 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.780567 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.780431 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.780567 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.780461 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ftjl\" (UniqueName: \"kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.881497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.881453 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.881497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.881496 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ftjl\" (UniqueName: \"kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.881700 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.881549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.881928 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.881904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.881981 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.881903 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.891869 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.891789 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ftjl\" (UniqueName: \"kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:11.947849 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:11.947813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:12.090931 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.090884 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc"] Jul 08 16:10:12.096687 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:12.096654 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecd07c1_a288_4a65_8252_50875101eb0e.slice/crio-2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621 WatchSource:0}: Error finding container 2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621: Status 404 returned error can't find the container with id 2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621 Jul 08 16:10:12.239593 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.239542 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2"] Jul 08 16:10:12.243145 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.243115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.252284 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.252251 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2"] Jul 08 16:10:12.278634 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.278597 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerID="9c2aa9976ae88e6e69abfdfa6edae0536b1d4fd17628f4c4066f5fd49c4704ac" exitCode=0 Jul 08 16:10:12.278792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.278675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerDied","Data":"9c2aa9976ae88e6e69abfdfa6edae0536b1d4fd17628f4c4066f5fd49c4704ac"} Jul 08 16:10:12.278792 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.278716 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerStarted","Data":"2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621"} Jul 08 16:10:12.385988 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.385943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.386201 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.386004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2drmt\" (UniqueName: \"kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.386201 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.386093 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.487238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.487196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.487460 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.487250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2drmt\" (UniqueName: \"kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.487460 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.487272 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.487667 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.487641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.487730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.487649 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.496991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.496957 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2drmt\" (UniqueName: \"kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.587226 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.587184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:12.625857 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.625818 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2"] Jul 08 16:10:12.630749 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.630722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.640439 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.640184 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2"] Jul 08 16:10:12.689692 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.689649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.689888 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.689774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.689961 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.689890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvmk\" (UniqueName: \"kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.742069 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.741955 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2"] Jul 08 16:10:12.745248 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:12.745220 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4174d89e_37c8_4c15_874d_1a71ab47aac8.slice/crio-7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99 WatchSource:0}: Error finding container 7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99: Status 404 returned error can't find the container with id 7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99 Jul 08 16:10:12.790888 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.790845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.791023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.790925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.791023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.790988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvmk\" (UniqueName: \"kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.791252 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.791231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.791337 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.791317 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.802906 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.802869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvmk\" (UniqueName: \"kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:12.942819 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:12.942787 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:13.040803 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.040761 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w"] Jul 08 16:10:13.045543 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.045520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.053559 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.053490 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w"] Jul 08 16:10:13.086938 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.086909 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2"] Jul 08 16:10:13.089571 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:13.089536 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dad3561_81fd_4693_a85c_590f28857d01.slice/crio-34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0 WatchSource:0}: Error finding container 34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0: Status 404 returned error can't find the container with id 34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0 Jul 08 16:10:13.195131 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.195084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.195278 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.195181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzlf5\" (UniqueName: \"kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.195278 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.195264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.285233 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.285145 2572 generic.go:356] "Generic (PLEG): container finished" podID="7dad3561-81fd-4693-a85c-590f28857d01" containerID="691428cded2d15818bc07626b9433b684b51375a3be201b10c57e3c902e53eae" exitCode=0 Jul 08 16:10:13.285383 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.285228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerDied","Data":"691428cded2d15818bc07626b9433b684b51375a3be201b10c57e3c902e53eae"} Jul 08 16:10:13.285383 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.285279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerStarted","Data":"34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0"} Jul 08 16:10:13.286924 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.286900 2572 generic.go:356] "Generic (PLEG): container finished" podID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerID="2ce5a359c92075a7e06785642c416eb9e573f23176443a282c90d8f4e4514fa4" exitCode=0 Jul 08 16:10:13.286998 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.286935 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" event={"ID":"4174d89e-37c8-4c15-874d-1a71ab47aac8","Type":"ContainerDied","Data":"2ce5a359c92075a7e06785642c416eb9e573f23176443a282c90d8f4e4514fa4"} Jul 08 16:10:13.286998 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.286970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" event={"ID":"4174d89e-37c8-4c15-874d-1a71ab47aac8","Type":"ContainerStarted","Data":"7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99"} Jul 08 16:10:13.296413 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.296382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.296552 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.296436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.296552 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.296506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlf5\" (UniqueName: \"kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.296798 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.296779 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.296798 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.296791 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.306837 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.306760 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzlf5\" (UniqueName: \"kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.358816 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.358775 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:13.506363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:13.506313 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w"] Jul 08 16:10:13.508612 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:13.508584 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd71df4_8e5a_4124_85a9_cf0066a09d4a.slice/crio-daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1 WatchSource:0}: Error finding container daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1: Status 404 returned error can't find the container with id daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1 Jul 08 16:10:14.298296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:14.297020 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerStarted","Data":"136e86765d43dc7e5203161124acc7e57ee0831528a56078b765e681515eb3be"} Jul 08 16:10:14.300550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:14.300522 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerStarted","Data":"6bed473b390fed44dec0215982a51d687e75809e589ff1dc7f53aea7007edb58"} Jul 08 16:10:14.310787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:14.310756 2572 generic.go:356] "Generic (PLEG): container finished" podID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerID="5a0f2e0584344ffb7a5854490b440400f5310e4906ba2ea018f0eea0ce1c045a" exitCode=0 Jul 08 16:10:14.310787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:14.310788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" event={"ID":"0fd71df4-8e5a-4124-85a9-cf0066a09d4a","Type":"ContainerDied","Data":"5a0f2e0584344ffb7a5854490b440400f5310e4906ba2ea018f0eea0ce1c045a"} Jul 08 16:10:14.310977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:14.310879 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" event={"ID":"0fd71df4-8e5a-4124-85a9-cf0066a09d4a","Type":"ContainerStarted","Data":"daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1"} Jul 08 16:10:15.317901 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.317821 2572 generic.go:356] "Generic (PLEG): container finished" podID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerID="2e08c3a0488cf8cac87905b7199f72c5bbdc48f834b3a67226ec550433a490f5" exitCode=0 Jul 08 16:10:15.318309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.317910 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" event={"ID":"4174d89e-37c8-4c15-874d-1a71ab47aac8","Type":"ContainerDied","Data":"2e08c3a0488cf8cac87905b7199f72c5bbdc48f834b3a67226ec550433a490f5"} Jul 08 16:10:15.319891 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.319861 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerID="136e86765d43dc7e5203161124acc7e57ee0831528a56078b765e681515eb3be" exitCode=0 Jul 08 16:10:15.320002 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.319950 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerDied","Data":"136e86765d43dc7e5203161124acc7e57ee0831528a56078b765e681515eb3be"} Jul 08 16:10:15.321626 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.321604 2572 generic.go:356] "Generic (PLEG): container finished" podID="7dad3561-81fd-4693-a85c-590f28857d01" containerID="6bed473b390fed44dec0215982a51d687e75809e589ff1dc7f53aea7007edb58" exitCode=0 Jul 08 16:10:15.321729 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:15.321666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerDied","Data":"6bed473b390fed44dec0215982a51d687e75809e589ff1dc7f53aea7007edb58"} Jul 08 16:10:16.329106 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.328989 2572 generic.go:356] "Generic (PLEG): container finished" podID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerID="a50ed3a93b4e3a9da0c8dabc59a40b77aef57de3506bb14d75235778ae90bba0" exitCode=0 Jul 08 16:10:16.329106 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.329075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" event={"ID":"0fd71df4-8e5a-4124-85a9-cf0066a09d4a","Type":"ContainerDied","Data":"a50ed3a93b4e3a9da0c8dabc59a40b77aef57de3506bb14d75235778ae90bba0"} Jul 08 16:10:16.331446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.331421 2572 generic.go:356] "Generic (PLEG): container finished" podID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerID="8e5dd24f16396a57c652d88359fcecdda3618e979e45a2c18bc3053c23b24f03" exitCode=0 Jul 08 16:10:16.331534 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.331502 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" event={"ID":"4174d89e-37c8-4c15-874d-1a71ab47aac8","Type":"ContainerDied","Data":"8e5dd24f16396a57c652d88359fcecdda3618e979e45a2c18bc3053c23b24f03"} Jul 08 16:10:16.333477 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.333459 2572 generic.go:356] "Generic (PLEG): container finished" podID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerID="65dd4481a2d618eefa17485ce922a68764d99e81797da51010408052bf484130" exitCode=0 Jul 08 16:10:16.333556 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.333536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerDied","Data":"65dd4481a2d618eefa17485ce922a68764d99e81797da51010408052bf484130"} Jul 08 16:10:16.335718 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.335691 2572 generic.go:356] "Generic (PLEG): container finished" podID="7dad3561-81fd-4693-a85c-590f28857d01" containerID="a1db58e748e23700048c81053abff90988b5d4c1ecf1f8e5641b2c8874d9c06f" exitCode=0 Jul 08 16:10:16.335829 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:16.335746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerDied","Data":"a1db58e748e23700048c81053abff90988b5d4c1ecf1f8e5641b2c8874d9c06f"} Jul 08 16:10:17.342932 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.342900 2572 generic.go:356] "Generic (PLEG): container finished" podID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerID="6aceb08e727445f26dd5b3acc0f4e4f17af46b7b1617564919e8d32892080dfc" exitCode=0 Jul 08 16:10:17.343361 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.342989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" event={"ID":"0fd71df4-8e5a-4124-85a9-cf0066a09d4a","Type":"ContainerDied","Data":"6aceb08e727445f26dd5b3acc0f4e4f17af46b7b1617564919e8d32892080dfc"} Jul 08 16:10:17.502878 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.502847 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:17.539320 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.539296 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:17.541350 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.541331 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:17.636675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636593 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle\") pod \"9ecd07c1-a288-4a65-8252-50875101eb0e\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636675 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util\") pod \"4174d89e-37c8-4c15-874d-1a71ab47aac8\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636700 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ftjl\" (UniqueName: \"kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl\") pod \"9ecd07c1-a288-4a65-8252-50875101eb0e\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636724 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2drmt\" (UniqueName: \"kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt\") pod \"4174d89e-37c8-4c15-874d-1a71ab47aac8\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636758 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle\") pod \"7dad3561-81fd-4693-a85c-590f28857d01\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636772 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util\") pod \"7dad3561-81fd-4693-a85c-590f28857d01\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " Jul 08 16:10:17.636822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636794 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle\") pod \"4174d89e-37c8-4c15-874d-1a71ab47aac8\" (UID: \"4174d89e-37c8-4c15-874d-1a71ab47aac8\") " Jul 08 16:10:17.637148 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636824 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util\") pod \"9ecd07c1-a288-4a65-8252-50875101eb0e\" (UID: \"9ecd07c1-a288-4a65-8252-50875101eb0e\") " Jul 08 16:10:17.637148 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.636862 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvvmk\" (UniqueName: \"kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk\") pod \"7dad3561-81fd-4693-a85c-590f28857d01\" (UID: \"7dad3561-81fd-4693-a85c-590f28857d01\") " Jul 08 16:10:17.637489 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.637302 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle" (OuterVolumeSpecName: "bundle") pod "9ecd07c1-a288-4a65-8252-50875101eb0e" (UID: "9ecd07c1-a288-4a65-8252-50875101eb0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.637565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.637473 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle" (OuterVolumeSpecName: "bundle") pod "7dad3561-81fd-4693-a85c-590f28857d01" (UID: "7dad3561-81fd-4693-a85c-590f28857d01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.639208 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.639176 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle" (OuterVolumeSpecName: "bundle") pod "4174d89e-37c8-4c15-874d-1a71ab47aac8" (UID: "4174d89e-37c8-4c15-874d-1a71ab47aac8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.639377 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.639349 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt" (OuterVolumeSpecName: "kube-api-access-2drmt") pod "4174d89e-37c8-4c15-874d-1a71ab47aac8" (UID: "4174d89e-37c8-4c15-874d-1a71ab47aac8"). InnerVolumeSpecName "kube-api-access-2drmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:10:17.639685 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.639652 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl" (OuterVolumeSpecName: "kube-api-access-8ftjl") pod "9ecd07c1-a288-4a65-8252-50875101eb0e" (UID: "9ecd07c1-a288-4a65-8252-50875101eb0e"). InnerVolumeSpecName "kube-api-access-8ftjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:10:17.639787 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.639683 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk" (OuterVolumeSpecName: "kube-api-access-gvvmk") pod "7dad3561-81fd-4693-a85c-590f28857d01" (UID: "7dad3561-81fd-4693-a85c-590f28857d01"). InnerVolumeSpecName "kube-api-access-gvvmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:10:17.642737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.642717 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util" (OuterVolumeSpecName: "util") pod "9ecd07c1-a288-4a65-8252-50875101eb0e" (UID: "9ecd07c1-a288-4a65-8252-50875101eb0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.643448 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.643425 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util" (OuterVolumeSpecName: "util") pod "4174d89e-37c8-4c15-874d-1a71ab47aac8" (UID: "4174d89e-37c8-4c15-874d-1a71ab47aac8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.644387 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.644368 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util" (OuterVolumeSpecName: "util") pod "7dad3561-81fd-4693-a85c-590f28857d01" (UID: "7dad3561-81fd-4693-a85c-590f28857d01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:17.737690 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737654 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvvmk\" (UniqueName: \"kubernetes.io/projected/7dad3561-81fd-4693-a85c-590f28857d01-kube-api-access-gvvmk\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737690 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737684 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737690 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737694 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737703 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ftjl\" (UniqueName: \"kubernetes.io/projected/9ecd07c1-a288-4a65-8252-50875101eb0e-kube-api-access-8ftjl\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737713 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2drmt\" (UniqueName: \"kubernetes.io/projected/4174d89e-37c8-4c15-874d-1a71ab47aac8-kube-api-access-2drmt\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737721 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737728 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7dad3561-81fd-4693-a85c-590f28857d01-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737735 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4174d89e-37c8-4c15-874d-1a71ab47aac8-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:17.737904 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:17.737742 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ecd07c1-a288-4a65-8252-50875101eb0e-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:18.350322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.350288 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" Jul 08 16:10:18.350322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.350298 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2" event={"ID":"4174d89e-37c8-4c15-874d-1a71ab47aac8","Type":"ContainerDied","Data":"7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99"} Jul 08 16:10:18.350751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.350397 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bb94a3dba02505d43036209d8fcf2419c42e31e5789ac8c34b35740ec909f99" Jul 08 16:10:18.352322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.352303 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" Jul 08 16:10:18.352447 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.352297 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc" event={"ID":"9ecd07c1-a288-4a65-8252-50875101eb0e","Type":"ContainerDied","Data":"2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621"} Jul 08 16:10:18.352447 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.352407 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b250353b7a030018dcdd89f9bacd711a7d7f74d4a88bdcfe63f30468f0c6621" Jul 08 16:10:18.354179 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.354153 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" Jul 08 16:10:18.354179 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.354174 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2" event={"ID":"7dad3561-81fd-4693-a85c-590f28857d01","Type":"ContainerDied","Data":"34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0"} Jul 08 16:10:18.354352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.354210 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c9d83c201aaa3df21063b0dcdf1667b196ac7bb405b68409bd1694e6afcfa0" Jul 08 16:10:18.486057 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.486002 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:18.646907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.646815 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle\") pod \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " Jul 08 16:10:18.646907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.646868 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util\") pod \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " Jul 08 16:10:18.646907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.646903 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzlf5\" (UniqueName: \"kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5\") pod \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\" (UID: \"0fd71df4-8e5a-4124-85a9-cf0066a09d4a\") " Jul 08 16:10:18.647629 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.647594 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle" (OuterVolumeSpecName: "bundle") pod "0fd71df4-8e5a-4124-85a9-cf0066a09d4a" (UID: "0fd71df4-8e5a-4124-85a9-cf0066a09d4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:18.648996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.648972 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5" (OuterVolumeSpecName: "kube-api-access-gzlf5") pod "0fd71df4-8e5a-4124-85a9-cf0066a09d4a" (UID: "0fd71df4-8e5a-4124-85a9-cf0066a09d4a"). InnerVolumeSpecName "kube-api-access-gzlf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:10:18.655117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.655091 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util" (OuterVolumeSpecName: "util") pod "0fd71df4-8e5a-4124-85a9-cf0066a09d4a" (UID: "0fd71df4-8e5a-4124-85a9-cf0066a09d4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:10:18.748141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.748101 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:18.748141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.748139 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-util\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:18.748141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:18.748148 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzlf5\" (UniqueName: \"kubernetes.io/projected/0fd71df4-8e5a-4124-85a9-cf0066a09d4a-kube-api-access-gzlf5\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:10:19.360768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:19.360735 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" Jul 08 16:10:19.360768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:19.360766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w" event={"ID":"0fd71df4-8e5a-4124-85a9-cf0066a09d4a","Type":"ContainerDied","Data":"daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1"} Jul 08 16:10:19.361221 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:19.360807 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daa33be13a455b01d32fa6b266f3fc37b03882ce47ac6e1daa67300f0fa9aba1" Jul 08 16:10:25.104012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:25.103973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:27.738714 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.738675 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7"] Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739049 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739061 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739071 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739076 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739084 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739090 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739095 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739101 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739108 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739113 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739131 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739137 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739143 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739150 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739159 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739165 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739169 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739174 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739183 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739188 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="util" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739194 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739199 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="pull" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739206 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="extract" Jul 08 16:10:27.739234 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739211 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="extract" Jul 08 16:10:27.740013 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739266 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd71df4-8e5a-4124-85a9-cf0066a09d4a" containerName="extract" Jul 08 16:10:27.740013 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739273 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ecd07c1-a288-4a65-8252-50875101eb0e" containerName="extract" Jul 08 16:10:27.740013 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739279 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4174d89e-37c8-4c15-874d-1a71ab47aac8" containerName="extract" Jul 08 16:10:27.740013 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.739286 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dad3561-81fd-4693-a85c-590f28857d01" containerName="extract" Jul 08 16:10:27.742784 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.742768 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:27.745455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.745429 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-56qgc\"" Jul 08 16:10:27.757771 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.757732 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7"] Jul 08 16:10:27.927117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:27.927078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfff9\" (UniqueName: \"kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9\") pod \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" (UID: \"d3f91ef4-9444-49b5-9385-401e5e30f451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:28.027925 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.027821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfff9\" (UniqueName: \"kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9\") pod \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" (UID: \"d3f91ef4-9444-49b5-9385-401e5e30f451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:28.042361 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.042329 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfff9\" (UniqueName: \"kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9\") pod \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" (UID: \"d3f91ef4-9444-49b5-9385-401e5e30f451\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:28.053178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.053145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:28.208072 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.208024 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7"] Jul 08 16:10:28.209213 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:28.209187 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f91ef4_9444_49b5_9385_401e5e30f451.slice/crio-027d84a6ffd0615dad5b3b88c44f028ab9c18a5d337c237b2aab7ad561751120 WatchSource:0}: Error finding container 027d84a6ffd0615dad5b3b88c44f028ab9c18a5d337c237b2aab7ad561751120: Status 404 returned error can't find the container with id 027d84a6ffd0615dad5b3b88c44f028ab9c18a5d337c237b2aab7ad561751120 Jul 08 16:10:28.233300 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.233267 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cf978ffb7-5gb8w"] Jul 08 16:10:28.237969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.237947 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.250390 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.250361 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf978ffb7-5gb8w"] Jul 08 16:10:28.330606 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330606 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-oauth-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330675 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-service-ca\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jjcg\" (UniqueName: \"kubernetes.io/projected/4befccda-c6ea-415e-926e-9d82767359f9-kube-api-access-7jjcg\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-console-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-trusted-ca-bundle\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.330853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.330827 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-oauth-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.361647 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.361605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:28.411320 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.411283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" event={"ID":"d3f91ef4-9444-49b5-9385-401e5e30f451","Type":"ContainerStarted","Data":"027d84a6ffd0615dad5b3b88c44f028ab9c18a5d337c237b2aab7ad561751120"} Jul 08 16:10:28.431688 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-service-ca\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jjcg\" (UniqueName: \"kubernetes.io/projected/4befccda-c6ea-415e-926e-9d82767359f9-kube-api-access-7jjcg\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-console-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431749 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-trusted-ca-bundle\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-oauth-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431956 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.431956 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.431838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-oauth-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.432537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.432508 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-service-ca\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.432659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.432549 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-console-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.432659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.432632 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-oauth-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.432742 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.432663 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4befccda-c6ea-415e-926e-9d82767359f9-trusted-ca-bundle\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.434413 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.434391 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-oauth-config\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.434640 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.434619 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4befccda-c6ea-415e-926e-9d82767359f9-console-serving-cert\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.450012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.449983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jjcg\" (UniqueName: \"kubernetes.io/projected/4befccda-c6ea-415e-926e-9d82767359f9-kube-api-access-7jjcg\") pod \"console-7cf978ffb7-5gb8w\" (UID: \"4befccda-c6ea-415e-926e-9d82767359f9\") " pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.547676 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.547631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:28.616487 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.616443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:28.693356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.693326 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf978ffb7-5gb8w"] Jul 08 16:10:28.695333 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:28.695304 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4befccda_c6ea_415e_926e_9d82767359f9.slice/crio-cb6ddab5028e865d586c9168b165b5669d3e8916fd1fe5625cf64e38341b612f WatchSource:0}: Error finding container cb6ddab5028e865d586c9168b165b5669d3e8916fd1fe5625cf64e38341b612f: Status 404 returned error can't find the container with id cb6ddab5028e865d586c9168b165b5669d3e8916fd1fe5625cf64e38341b612f Jul 08 16:10:28.716597 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:28.716562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:29.417730 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:29.417686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf978ffb7-5gb8w" event={"ID":"4befccda-c6ea-415e-926e-9d82767359f9","Type":"ContainerStarted","Data":"2835b83b89488a6242ff30d67bdcc64aa82a199fa6e803ee88c3f556fb301a91"} Jul 08 16:10:29.418160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:29.417751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf978ffb7-5gb8w" event={"ID":"4befccda-c6ea-415e-926e-9d82767359f9","Type":"ContainerStarted","Data":"cb6ddab5028e865d586c9168b165b5669d3e8916fd1fe5625cf64e38341b612f"} Jul 08 16:10:29.447483 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:29.447421 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cf978ffb7-5gb8w" podStartSLOduration=1.447404742 podStartE2EDuration="1.447404742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:29.444851364 +0000 UTC m=+401.026723875" watchObservedRunningTime="2026-07-08 16:10:29.447404742 +0000 UTC m=+401.029277304" Jul 08 16:10:29.766991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:29.766931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:31.892494 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:31.892403 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7msqs"] Jul 08 16:10:31.895573 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:31.895554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:31.898313 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:31.898286 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v9vjd\"" Jul 08 16:10:31.908735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:31.908694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7msqs"] Jul 08 16:10:32.063631 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.063589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8hx\" (UniqueName: \"kubernetes.io/projected/4be380d6-c39c-4fd4-9c39-a4daa112df29-kube-api-access-mq8hx\") pod \"authorino-operator-75cc8d5cb7-7msqs\" (UID: \"4be380d6-c39c-4fd4-9c39-a4daa112df29\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:32.164985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.164897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8hx\" (UniqueName: \"kubernetes.io/projected/4be380d6-c39c-4fd4-9c39-a4daa112df29-kube-api-access-mq8hx\") pod \"authorino-operator-75cc8d5cb7-7msqs\" (UID: \"4be380d6-c39c-4fd4-9c39-a4daa112df29\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:32.177696 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.177660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8hx\" (UniqueName: \"kubernetes.io/projected/4be380d6-c39c-4fd4-9c39-a4daa112df29-kube-api-access-mq8hx\") pod \"authorino-operator-75cc8d5cb7-7msqs\" (UID: \"4be380d6-c39c-4fd4-9c39-a4daa112df29\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:32.206348 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.206289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:32.376761 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.376727 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7msqs"] Jul 08 16:10:32.378078 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:32.378025 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be380d6_c39c_4fd4_9c39_a4daa112df29.slice/crio-a6999e4342e7160636a6c3d61a105a0a078ad744cde5ce1b4a3d9e0c259497b2 WatchSource:0}: Error finding container a6999e4342e7160636a6c3d61a105a0a078ad744cde5ce1b4a3d9e0c259497b2: Status 404 returned error can't find the container with id a6999e4342e7160636a6c3d61a105a0a078ad744cde5ce1b4a3d9e0c259497b2 Jul 08 16:10:32.436665 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.436622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" event={"ID":"d3f91ef4-9444-49b5-9385-401e5e30f451","Type":"ContainerStarted","Data":"99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a"} Jul 08 16:10:32.436877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.436734 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:32.437954 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.437919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" event={"ID":"4be380d6-c39c-4fd4-9c39-a4daa112df29","Type":"ContainerStarted","Data":"a6999e4342e7160636a6c3d61a105a0a078ad744cde5ce1b4a3d9e0c259497b2"} Jul 08 16:10:32.472312 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.472255 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" podStartSLOduration=2.187394789 podStartE2EDuration="5.472234936s" totalImagesPullingTime="3.284840147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:32.468588755 +0000 UTC m=+404.050461406" watchObservedRunningTime="2026-07-08 16:10:32.472234936 +0000 UTC m=+404.054107448" Jul 08 16:10:32.605023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.604978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:32.719876 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.719773 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:32.935741 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:32.935711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:34.583271 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:34.583242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:35.460185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:35.460149 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" event={"ID":"4be380d6-c39c-4fd4-9c39-a4daa112df29","Type":"ContainerStarted","Data":"2dfa029d86f9719a40848a34437504a82c23957545fdb346c04a05fbb25a62fa"} Jul 08 16:10:35.460407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:35.460208 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:35.486562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:35.486507 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" podStartSLOduration=1.856456766 podStartE2EDuration="4.486488812s" totalImagesPullingTime="2.630032046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:10:35.48611499 +0000 UTC m=+407.067987501" watchObservedRunningTime="2026-07-08 16:10:35.486488812 +0000 UTC m=+407.068361322" Jul 08 16:10:35.752761 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:35.752645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:35.866192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:35.866155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:37.602553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:37.602515 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:38.548553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:38.548513 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:38.548738 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:38.548582 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:38.553571 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:38.553549 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:39.485525 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:39.485494 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cf978ffb7-5gb8w" Jul 08 16:10:39.542118 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:39.542079 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:10:39.669648 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:39.669613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:39.918164 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:39.918070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:40.016291 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:40.016256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:40.710049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:40.710005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:40.815023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:40.814982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:43.449648 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:43.449613 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:10:46.120722 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:46.120681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:46.184565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:46.184524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:46.471697 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:46.471665 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7msqs" Jul 08 16:10:46.525423 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:46.525374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:46.630624 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:46.630582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:49.505345 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:49.505312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:49.571985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:49.571947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:51.330481 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.330442 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6"] Jul 08 16:10:51.335626 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.335604 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.340510 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.340476 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 16:10:51.340737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.340721 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hbtxw\"" Jul 08 16:10:51.341376 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.341359 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 16:10:51.356083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.356051 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6"] Jul 08 16:10:51.359692 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.359662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:51.423491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.423455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.423718 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.423519 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a019548b-3bdf-4d2c-88e0-4a237b753817-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.423718 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.423613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h77\" (UniqueName: \"kubernetes.io/projected/a019548b-3bdf-4d2c-88e0-4a237b753817-kube-api-access-28h77\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.524848 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.524806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.525027 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.524899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a019548b-3bdf-4d2c-88e0-4a237b753817-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.525027 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:10:51.524946 2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 08 16:10:51.525027 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.524946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h77\" (UniqueName: \"kubernetes.io/projected/a019548b-3bdf-4d2c-88e0-4a237b753817-kube-api-access-28h77\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.525027 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:10:51.525016 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert podName:a019548b-3bdf-4d2c-88e0-4a237b753817 nodeName:}" failed. No retries permitted until 2026-07-08 16:10:52.024996584 +0000 UTC m=+423.606869073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-wnkn6" (UID: "a019548b-3bdf-4d2c-88e0-4a237b753817") : secret "plugin-serving-cert" not found Jul 08 16:10:51.525545 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.525523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a019548b-3bdf-4d2c-88e0-4a237b753817-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.535192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.535167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h77\" (UniqueName: \"kubernetes.io/projected/a019548b-3bdf-4d2c-88e0-4a237b753817-kube-api-access-28h77\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:51.688120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:51.688075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:52.030788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:52.030692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:52.033112 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:52.033079 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a019548b-3bdf-4d2c-88e0-4a237b753817-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wnkn6\" (UID: \"a019548b-3bdf-4d2c-88e0-4a237b753817\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:52.244896 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:52.244859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" Jul 08 16:10:52.387635 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:52.387611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6"] Jul 08 16:10:52.389672 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:10:52.389631 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda019548b_3bdf_4d2c_88e0_4a237b753817.slice/crio-073b4839a88e1c13d81f035fc6ef7bc6ca808ae8238228534457ebae62bffc7a WatchSource:0}: Error finding container 073b4839a88e1c13d81f035fc6ef7bc6ca808ae8238228534457ebae62bffc7a: Status 404 returned error can't find the container with id 073b4839a88e1c13d81f035fc6ef7bc6ca808ae8238228534457ebae62bffc7a Jul 08 16:10:52.553453 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:52.553359 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" event={"ID":"a019548b-3bdf-4d2c-88e0-4a237b753817","Type":"ContainerStarted","Data":"073b4839a88e1c13d81f035fc6ef7bc6ca808ae8238228534457ebae62bffc7a"} Jul 08 16:10:53.682381 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:53.682350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:10:53.783618 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:10:53.783570 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:00.428681 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:00.428589 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:00.550480 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:00.550443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:01.493475 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.493439 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs"] Jul 08 16:11:01.497161 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.497139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.500274 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.500245 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hdf7b\"" Jul 08 16:11:01.513862 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.513833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs"] Jul 08 16:11:01.619427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.619387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.619612 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.619456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fxb\" (UniqueName: \"kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.720492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.720446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.720666 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.720521 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fxb\" (UniqueName: \"kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.720853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.720834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.735301 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.735271 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fxb\" (UniqueName: \"kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb\") pod \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.809707 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.809617 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:01.835678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.835638 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs"] Jul 08 16:11:01.842059 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.842005 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs"] Jul 08 16:11:01.856881 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.856849 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:01.862776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.862744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:01.874374 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.874348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:01.878751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.878712 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7"] Jul 08 16:11:01.878987 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.878958 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" containerName="manager" containerID="cri-o://99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a" gracePeriod=2 Jul 08 16:11:01.889171 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.889139 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7"] Jul 08 16:11:01.895150 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:01.895085 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" is forbidden: User \"system:node:ip-10-0-136-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-114.ec2.internal' and this object" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:11:01.922290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.922210 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:01.922469 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.922373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xmjw\" (UniqueName: \"kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:01.922469 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.922382 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs"] Jul 08 16:11:01.924080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.923480 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" containerName="manager" Jul 08 16:11:01.924080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.923499 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" containerName="manager" Jul 08 16:11:01.924080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.923567 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" containerName="manager" Jul 08 16:11:01.926880 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.926856 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:01.929734 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:01.929699 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" is forbidden: User \"system:node:ip-10-0-136-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-114.ec2.internal' and this object" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:11:01.941558 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:01.941496 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs"] Jul 08 16:11:02.023391 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.023333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xmjw\" (UniqueName: \"kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:02.023586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.023427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqnzw\" (UniqueName: \"kubernetes.io/projected/cd2ba086-382f-4a7d-98a8-42aa301cbe36-kube-api-access-vqnzw\") pod \"limitador-operator-controller-manager-859d7b78bd-dwlcs\" (UID: \"cd2ba086-382f-4a7d-98a8-42aa301cbe36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:02.023586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.023459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:02.023879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.023855 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:02.036948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.036918 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xmjw\" (UniqueName: \"kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hxvh\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:02.123053 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.123014 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:11:02.123964 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.123943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqnzw\" (UniqueName: \"kubernetes.io/projected/cd2ba086-382f-4a7d-98a8-42aa301cbe36-kube-api-access-vqnzw\") pod \"limitador-operator-controller-manager-859d7b78bd-dwlcs\" (UID: \"cd2ba086-382f-4a7d-98a8-42aa301cbe36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:02.125467 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:02.125440 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-zfzk7\" is forbidden: User \"system:node:ip-10-0-136-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-114.ec2.internal' and this object" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:11:02.135770 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.135741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqnzw\" (UniqueName: \"kubernetes.io/projected/cd2ba086-382f-4a7d-98a8-42aa301cbe36-kube-api-access-vqnzw\") pod \"limitador-operator-controller-manager-859d7b78bd-dwlcs\" (UID: \"cd2ba086-382f-4a7d-98a8-42aa301cbe36\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:02.179671 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.179631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:02.225075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.225020 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfff9\" (UniqueName: \"kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9\") pod \"d3f91ef4-9444-49b5-9385-401e5e30f451\" (UID: \"d3f91ef4-9444-49b5-9385-401e5e30f451\") " Jul 08 16:11:02.227479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.227445 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9" (OuterVolumeSpecName: "kube-api-access-jfff9") pod "d3f91ef4-9444-49b5-9385-401e5e30f451" (UID: "d3f91ef4-9444-49b5-9385-401e5e30f451"). InnerVolumeSpecName "kube-api-access-jfff9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:11:02.256912 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.256850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:02.326603 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.326530 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfff9\" (UniqueName: \"kubernetes.io/projected/d3f91ef4-9444-49b5-9385-401e5e30f451-kube-api-access-jfff9\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:02.362457 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.362383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:02.363936 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:02.363905 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c66075_5d6d_4ca2_8e4e_b25baa63524e.slice/crio-e96ec12460c294bef6982f516f93931849f33e4e93b7637eda1e552ae6071a2c WatchSource:0}: Error finding container e96ec12460c294bef6982f516f93931849f33e4e93b7637eda1e552ae6071a2c: Status 404 returned error can't find the container with id e96ec12460c294bef6982f516f93931849f33e4e93b7637eda1e552ae6071a2c Jul 08 16:11:02.417632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.417599 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs"] Jul 08 16:11:02.418979 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:02.418953 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2ba086_382f_4a7d_98a8_42aa301cbe36.slice/crio-0bd5a34bd756984a835b7c3280223d9b7a2e5ebb3ac8f2fd737749e8006d3a90 WatchSource:0}: Error finding container 0bd5a34bd756984a835b7c3280223d9b7a2e5ebb3ac8f2fd737749e8006d3a90: Status 404 returned error can't find the container with id 0bd5a34bd756984a835b7c3280223d9b7a2e5ebb3ac8f2fd737749e8006d3a90 Jul 08 16:11:02.472204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.472178 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3f91ef4-9444-49b5-9385-401e5e30f451" path="/var/lib/kubelet/pods/d3f91ef4-9444-49b5-9385-401e5e30f451/volumes" Jul 08 16:11:02.624192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.624099 2572 generic.go:356] "Generic (PLEG): container finished" podID="d3f91ef4-9444-49b5-9385-401e5e30f451" containerID="99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a" exitCode=0 Jul 08 16:11:02.624192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.624153 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zfzk7" Jul 08 16:11:02.624192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.624172 2572 scope.go:117] "RemoveContainer" containerID="99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a" Jul 08 16:11:02.626774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.626565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" event={"ID":"cd2ba086-382f-4a7d-98a8-42aa301cbe36","Type":"ContainerStarted","Data":"8565deff1f37bf05b33c65394f125cb36f7c66570289add3ed1cac4858e24205"} Jul 08 16:11:02.626774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.626632 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" event={"ID":"cd2ba086-382f-4a7d-98a8-42aa301cbe36","Type":"ContainerStarted","Data":"0bd5a34bd756984a835b7c3280223d9b7a2e5ebb3ac8f2fd737749e8006d3a90"} Jul 08 16:11:02.626948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.626929 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:02.628616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.628581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" event={"ID":"97c66075-5d6d-4ca2-8e4e-b25baa63524e","Type":"ContainerStarted","Data":"e96ec12460c294bef6982f516f93931849f33e4e93b7637eda1e552ae6071a2c"} Jul 08 16:11:02.635385 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.635359 2572 scope.go:117] "RemoveContainer" containerID="99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a" Jul 08 16:11:02.635782 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:02.635753 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a\": container with ID starting with 99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a not found: ID does not exist" containerID="99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a" Jul 08 16:11:02.635877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.635795 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a"} err="failed to get container status \"99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a\": rpc error: code = NotFound desc = could not find container \"99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a\": container with ID starting with 99c8fbf6a9a2fb1100659027d721f87b9040bd7e349fb28d80a0bbedab750d7a not found: ID does not exist" Jul 08 16:11:02.645968 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:02.645910 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" podStartSLOduration=1.645887254 podStartE2EDuration="1.645887254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:02.64376867 +0000 UTC m=+434.225641181" watchObservedRunningTime="2026-07-08 16:11:02.645887254 +0000 UTC m=+434.227759778" Jul 08 16:11:02.806592 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:02.806557 2572 log.go:32] "RunPodSandbox from runtime service failed" err=< Jul 08 16:11:02.806592 ip-10-0-136-114 kubenswrapper[2572]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6pszs_kuadrant-system_aa86fb25-0399-489c-96d4-edec2d838956_0(985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6pszs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4" Netns:"/var/run/netns/2258dcd4-240c-4023-af65-0ef0c171b8ca" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-6pszs;K8S_POD_INFRA_CONTAINER_ID=985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4;K8S_POD_UID=aa86fb25-0399-489c-96d4-edec2d838956" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs/aa86fb25-0399-489c-96d4-edec2d838956:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs 985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs 985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-6pszs" not found Jul 08 16:11:02.806592 ip-10-0-136-114 kubenswrapper[2572]: ' Jul 08 16:11:02.806592 ip-10-0-136-114 kubenswrapper[2572]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 08 16:11:02.806592 ip-10-0-136-114 kubenswrapper[2572]: > Jul 08 16:11:02.806803 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:02.806623 2572 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jul 08 16:11:02.806803 ip-10-0-136-114 kubenswrapper[2572]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-6pszs_kuadrant-system_aa86fb25-0399-489c-96d4-edec2d838956_0(985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-6pszs to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4" Netns:"/var/run/netns/2258dcd4-240c-4023-af65-0ef0c171b8ca" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-6pszs;K8S_POD_INFRA_CONTAINER_ID=985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4;K8S_POD_UID=aa86fb25-0399-489c-96d4-edec2d838956" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs/aa86fb25-0399-489c-96d4-edec2d838956:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs 985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4 network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs 985201fbf34165c96668378bbbaa2e1b34022e52b251d24a43e2d704c6f4a3a4 network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-6pszs" not found Jul 08 16:11:02.806803 ip-10-0-136-114 kubenswrapper[2572]: ' Jul 08 16:11:02.806803 ip-10-0-136-114 kubenswrapper[2572]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jul 08 16:11:02.806803 ip-10-0-136-114 kubenswrapper[2572]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:03.637443 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.637407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:03.646833 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.646803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:03.649317 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:03.649286 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" is forbidden: User \"system:node:ip-10-0-136-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-114.ec2.internal' and this object" podUID="aa86fb25-0399-489c-96d4-edec2d838956" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:03.741065 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.741011 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume\") pod \"aa86fb25-0399-489c-96d4-edec2d838956\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " Jul 08 16:11:03.741238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.741103 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4fxb\" (UniqueName: \"kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb\") pod \"aa86fb25-0399-489c-96d4-edec2d838956\" (UID: \"aa86fb25-0399-489c-96d4-edec2d838956\") " Jul 08 16:11:03.741289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.741273 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa86fb25-0399-489c-96d4-edec2d838956" (UID: "aa86fb25-0399-489c-96d4-edec2d838956"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:11:03.741407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.741390 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa86fb25-0399-489c-96d4-edec2d838956-extensions-socket-volume\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:03.743641 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.743616 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb" (OuterVolumeSpecName: "kube-api-access-n4fxb") pod "aa86fb25-0399-489c-96d4-edec2d838956" (UID: "aa86fb25-0399-489c-96d4-edec2d838956"). InnerVolumeSpecName "kube-api-access-n4fxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:11:03.842734 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:03.842687 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4fxb\" (UniqueName: \"kubernetes.io/projected/aa86fb25-0399-489c-96d4-edec2d838956-kube-api-access-n4fxb\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:04.190474 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.190388 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:04.287377 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.287341 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:04.398710 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.398669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:04.475139 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.474126 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa86fb25-0399-489c-96d4-edec2d838956" path="/var/lib/kubelet/pods/aa86fb25-0399-489c-96d4-edec2d838956/volumes" Jul 08 16:11:04.483098 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.483063 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:04.571789 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.571716 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dcdb67bd4-j7dbm" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerName="console" containerID="cri-o://73c6642a7bd321c594e018009d33d0858856bcfad8075bc4dcc02b3e1d492347" gracePeriod=15 Jul 08 16:11:04.645072 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:04.645026 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:04.653132 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:04.653094 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-6pszs\" is forbidden: User \"system:node:ip-10-0-136-114.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-114.ec2.internal' and this object" podUID="aa86fb25-0399-489c-96d4-edec2d838956" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6pszs" Jul 08 16:11:08.181049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:08.180990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:08.281585 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:08.281543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:13.640133 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:13.640025 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dwlcs" Jul 08 16:11:13.783127 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:13.783087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:13.899408 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:13.899254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:14.229285 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:14.229250 2572 patch_prober.go:28] interesting pod/console-6dcdb67bd4-j7dbm container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 08 16:11:14.229486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:14.229327 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6dcdb67bd4-j7dbm" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 08 16:11:18.748953 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:18.748916 2572 generic.go:356] "Generic (PLEG): container finished" podID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerID="73c6642a7bd321c594e018009d33d0858856bcfad8075bc4dcc02b3e1d492347" exitCode=0 Jul 08 16:11:18.749407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:18.749016 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcdb67bd4-j7dbm" event={"ID":"5c8aa1cf-804a-43c1-9426-fd1973209d2e","Type":"ContainerDied","Data":"73c6642a7bd321c594e018009d33d0858856bcfad8075bc4dcc02b3e1d492347"} Jul 08 16:11:19.441623 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.441593 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:11:19.592636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592597 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdcpv\" (UniqueName: \"kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592655 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592685 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592723 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592758 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.592895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.592871 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert\") pod \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\" (UID: \"5c8aa1cf-804a-43c1-9426-fd1973209d2e\") " Jul 08 16:11:19.593191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593155 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:11:19.593191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593180 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config" (OuterVolumeSpecName: "console-config") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:11:19.593302 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593192 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:11:19.593302 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593198 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:11:19.593715 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593691 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-oauth-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.593820 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593716 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-trusted-ca-bundle\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.593820 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593731 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.593820 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.593744 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c8aa1cf-804a-43c1-9426-fd1973209d2e-service-ca\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.595242 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.595221 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:11:19.595321 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.595254 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:11:19.595321 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.595254 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv" (OuterVolumeSpecName: "kube-api-access-xdcpv") pod "5c8aa1cf-804a-43c1-9426-fd1973209d2e" (UID: "5c8aa1cf-804a-43c1-9426-fd1973209d2e"). InnerVolumeSpecName "kube-api-access-xdcpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:11:19.695209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.695167 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-serving-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.695209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.695202 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c8aa1cf-804a-43c1-9426-fd1973209d2e-console-oauth-config\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.695209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.695212 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdcpv\" (UniqueName: \"kubernetes.io/projected/5c8aa1cf-804a-43c1-9426-fd1973209d2e-kube-api-access-xdcpv\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:19.756076 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.756021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" event={"ID":"a019548b-3bdf-4d2c-88e0-4a237b753817","Type":"ContainerStarted","Data":"9a64778a1c409c716ceda8ec8659d37bd6a80984422d0687a6300b0929c72750"} Jul 08 16:11:19.757601 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.757577 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" event={"ID":"97c66075-5d6d-4ca2-8e4e-b25baa63524e","Type":"ContainerStarted","Data":"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8"} Jul 08 16:11:19.757672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.757653 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:19.758858 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.758831 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcdb67bd4-j7dbm" Jul 08 16:11:19.758858 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.758836 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcdb67bd4-j7dbm" event={"ID":"5c8aa1cf-804a-43c1-9426-fd1973209d2e","Type":"ContainerDied","Data":"94b6f8387b44bdc6c5c8518597c0e734f555a85b82d9a88fb581f996fca52b48"} Jul 08 16:11:19.759060 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.758878 2572 scope.go:117] "RemoveContainer" containerID="73c6642a7bd321c594e018009d33d0858856bcfad8075bc4dcc02b3e1d492347" Jul 08 16:11:19.775908 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.775863 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wnkn6" podStartSLOduration=1.667738575 podStartE2EDuration="28.775846985s" totalImagesPullingTime="27.10810841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:19.7739508 +0000 UTC m=+451.355823311" watchObservedRunningTime="2026-07-08 16:11:19.775846985 +0000 UTC m=+451.357719496" Jul 08 16:11:19.791095 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.791065 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:11:19.793266 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.793247 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dcdb67bd4-j7dbm"] Jul 08 16:11:19.814049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:19.813974 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" podStartSLOduration=1.709719695 podStartE2EDuration="18.813950769s" totalImagesPullingTime="17.104231074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:19.811369196 +0000 UTC m=+451.393241708" watchObservedRunningTime="2026-07-08 16:11:19.813950769 +0000 UTC m=+451.395823280" Jul 08 16:11:20.472998 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:20.472964 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" path="/var/lib/kubelet/pods/5c8aa1cf-804a-43c1-9426-fd1973209d2e/volumes" Jul 08 16:11:30.436104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:30.436059 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:30.538363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:30.538331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:30.767664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:30.767581 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:43.246760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.246720 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:43.247247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.246942 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" podUID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" containerName="manager" containerID="cri-o://4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8" gracePeriod=10 Jul 08 16:11:43.524113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.524083 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:43.581400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.581362 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume\") pod \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " Jul 08 16:11:43.581591 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.581440 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xmjw\" (UniqueName: \"kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw\") pod \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\" (UID: \"97c66075-5d6d-4ca2-8e4e-b25baa63524e\") " Jul 08 16:11:43.581862 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.581830 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97c66075-5d6d-4ca2-8e4e-b25baa63524e" (UID: "97c66075-5d6d-4ca2-8e4e-b25baa63524e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:11:43.583571 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.583533 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw" (OuterVolumeSpecName: "kube-api-access-5xmjw") pod "97c66075-5d6d-4ca2-8e4e-b25baa63524e" (UID: "97c66075-5d6d-4ca2-8e4e-b25baa63524e"). InnerVolumeSpecName "kube-api-access-5xmjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:11:43.682636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.682602 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xmjw\" (UniqueName: \"kubernetes.io/projected/97c66075-5d6d-4ca2-8e4e-b25baa63524e-kube-api-access-5xmjw\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:43.682636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.682631 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c66075-5d6d-4ca2-8e4e-b25baa63524e-extensions-socket-volume\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:11:43.910450 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.910364 2572 generic.go:356] "Generic (PLEG): container finished" podID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" containerID="4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8" exitCode=0 Jul 08 16:11:43.910450 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.910417 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" Jul 08 16:11:43.910642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.910449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" event={"ID":"97c66075-5d6d-4ca2-8e4e-b25baa63524e","Type":"ContainerDied","Data":"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8"} Jul 08 16:11:43.910642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.910506 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh" event={"ID":"97c66075-5d6d-4ca2-8e4e-b25baa63524e","Type":"ContainerDied","Data":"e96ec12460c294bef6982f516f93931849f33e4e93b7637eda1e552ae6071a2c"} Jul 08 16:11:43.910642 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.910528 2572 scope.go:117] "RemoveContainer" containerID="4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8" Jul 08 16:11:43.919594 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.919573 2572 scope.go:117] "RemoveContainer" containerID="4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8" Jul 08 16:11:43.919888 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:11:43.919864 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8\": container with ID starting with 4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8 not found: ID does not exist" containerID="4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8" Jul 08 16:11:43.919954 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.919903 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8"} err="failed to get container status \"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8\": rpc error: code = NotFound desc = could not find container \"4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8\": container with ID starting with 4fce488a0c4369a73ac15bdc623e9e1ebf11863fab20727bf575251ec3f1cdf8 not found: ID does not exist" Jul 08 16:11:43.969592 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.969553 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:43.977436 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:43.977406 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hxvh"] Jul 08 16:11:44.470975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:44.470943 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" path="/var/lib/kubelet/pods/97c66075-5d6d-4ca2-8e4e-b25baa63524e/volumes" Jul 08 16:11:47.237641 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.237604 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct"] Jul 08 16:11:47.238020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.237991 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerName="console" Jul 08 16:11:47.238020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.238003 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerName="console" Jul 08 16:11:47.238020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.238020 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" containerName="manager" Jul 08 16:11:47.238154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.238027 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" containerName="manager" Jul 08 16:11:47.238154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.238106 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c66075-5d6d-4ca2-8e4e-b25baa63524e" containerName="manager" Jul 08 16:11:47.238154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.238120 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c8aa1cf-804a-43c1-9426-fd1973209d2e" containerName="console" Jul 08 16:11:47.263652 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.263617 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:47.314839 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.314800 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct"] Jul 08 16:11:47.315001 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.314942 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.317684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.317661 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-snm8l\"" Jul 08 16:11:47.418108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td49p\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-kube-api-access-td49p\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418316 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418335 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46a042e-f294-47e4-81ed-31a07a6e65e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.418495 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.418487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td49p\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-kube-api-access-td49p\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46a042e-f294-47e4-81ed-31a07a6e65e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519821 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519876 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519848 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.519969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.519944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.520125 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.520052 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.520340 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.520313 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d46a042e-f294-47e4-81ed-31a07a6e65e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.521514 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.521491 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.521814 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.521792 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.529689 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.529664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.529812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.529738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td49p\" (UniqueName: \"kubernetes.io/projected/d46a042e-f294-47e4-81ed-31a07a6e65e9-kube-api-access-td49p\") pod \"maas-default-gateway-openshift-default-56654dcf7-8jjct\" (UID: \"d46a042e-f294-47e4-81ed-31a07a6e65e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.625899 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.625844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:47.699582 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.699555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:47.794570 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.794539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct"] Jul 08 16:11:47.795856 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:47.795832 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46a042e_f294_47e4_81ed_31a07a6e65e9.slice/crio-03c913b27abe30ddedd926024176bfecd54e2b6c760a75a4af4185b0f5ca3442 WatchSource:0}: Error finding container 03c913b27abe30ddedd926024176bfecd54e2b6c760a75a4af4185b0f5ca3442: Status 404 returned error can't find the container with id 03c913b27abe30ddedd926024176bfecd54e2b6c760a75a4af4185b0f5ca3442 Jul 08 16:11:47.798073 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.798016 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:11:47.798161 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.798121 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:11:47.798203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.798171 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:11:47.943119 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.943069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" event={"ID":"d46a042e-f294-47e4-81ed-31a07a6e65e9","Type":"ContainerStarted","Data":"2d6b1cdd9c265c7e079e21febb4f0f036999693146c892ae8d72d9d10f18edb4"} Jul 08 16:11:47.943317 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.943178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" event={"ID":"d46a042e-f294-47e4-81ed-31a07a6e65e9","Type":"ContainerStarted","Data":"03c913b27abe30ddedd926024176bfecd54e2b6c760a75a4af4185b0f5ca3442"} Jul 08 16:11:47.967655 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:47.967598 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" podStartSLOduration=0.967581257 podStartE2EDuration="967.581257ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:47.965199125 +0000 UTC m=+479.547071666" watchObservedRunningTime="2026-07-08 16:11:47.967581257 +0000 UTC m=+479.549453767" Jul 08 16:11:48.626272 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:48.626231 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:48.630991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:48.630963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:48.948672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:48.948638 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:48.949821 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:48.949798 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:11:49.711353 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.711317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:49.712647 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.712626 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:11:49.716352 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.716336 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.718799 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.718780 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 16:11:49.723910 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.723889 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:11:49.740798 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.740768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.740958 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.740823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9zlc\" (UniqueName: \"kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.808562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.808525 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:11:49.825550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.825513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:49.841634 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.841597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.841813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.841654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9zlc\" (UniqueName: \"kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.842273 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.842255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.850323 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.850292 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9zlc\" (UniqueName: \"kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc\") pod \"limitador-limitador-64c94fd64f-g8vrk\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:49.889017 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:49.888982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:50.027301 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.027206 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:50.204127 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.204095 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:11:50.206209 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:50.206177 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ecc364_1133_4aca_83a3_175c8e5162c0.slice/crio-f735ca3858c1703b28b5c3af0e7aa444d8471e5ee9ad1221bdcbebba422b73ac WatchSource:0}: Error finding container f735ca3858c1703b28b5c3af0e7aa444d8471e5ee9ad1221bdcbebba422b73ac: Status 404 returned error can't find the container with id f735ca3858c1703b28b5c3af0e7aa444d8471e5ee9ad1221bdcbebba422b73ac Jul 08 16:11:50.612020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.611936 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:11:50.645583 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.645543 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:11:50.645770 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.645675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:50.648656 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.648635 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-trxsj\"" Jul 08 16:11:50.652528 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.652491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:50.750857 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.750823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvn8\" (UniqueName: \"kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8\") pod \"authorino-58cd955675-hpgmz\" (UID: \"1f11b7cd-780d-4b9b-9976-7b6c546f8b85\") " pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:50.753491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.753461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:11:50.804991 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.804956 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:11:50.817303 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.817273 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:11:50.817528 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.817360 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:11:50.851871 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.851832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knvn8\" (UniqueName: \"kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8\") pod \"authorino-58cd955675-hpgmz\" (UID: \"1f11b7cd-780d-4b9b-9976-7b6c546f8b85\") " pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:50.852101 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.851893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj7h4\" (UniqueName: \"kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4\") pod \"authorino-75d556bd77-wn2gf\" (UID: \"e8cef542-9b82-42ca-b72e-6c85920e7173\") " pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:11:50.860351 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.860321 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvn8\" (UniqueName: \"kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8\") pod \"authorino-58cd955675-hpgmz\" (UID: \"1f11b7cd-780d-4b9b-9976-7b6c546f8b85\") " pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:50.953357 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.953321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7h4\" (UniqueName: \"kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4\") pod \"authorino-75d556bd77-wn2gf\" (UID: \"e8cef542-9b82-42ca-b72e-6c85920e7173\") " pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:11:50.956129 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.956102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:50.962613 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.962587 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj7h4\" (UniqueName: \"kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4\") pod \"authorino-75d556bd77-wn2gf\" (UID: \"e8cef542-9b82-42ca-b72e-6c85920e7173\") " pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:11:50.964337 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:50.964308 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" event={"ID":"c7ecc364-1133-4aca-83a3-175c8e5162c0","Type":"ContainerStarted","Data":"f735ca3858c1703b28b5c3af0e7aa444d8471e5ee9ad1221bdcbebba422b73ac"} Jul 08 16:11:51.111726 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:51.111691 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:11:51.117057 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:51.117005 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f11b7cd_780d_4b9b_9976_7b6c546f8b85.slice/crio-c16635154e1d15d3120ee67ddac5912a40e34648a3001553787c34c46fcb0915 WatchSource:0}: Error finding container c16635154e1d15d3120ee67ddac5912a40e34648a3001553787c34c46fcb0915: Status 404 returned error can't find the container with id c16635154e1d15d3120ee67ddac5912a40e34648a3001553787c34c46fcb0915 Jul 08 16:11:51.128506 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:51.128473 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:11:51.325319 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:51.325287 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:11:51.327319 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:11:51.327287 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8cef542_9b82_42ca_b72e_6c85920e7173.slice/crio-46260b99c84512b3dd515854748c54ad74c052d32baf01b7e3c8bdd05164acfb WatchSource:0}: Error finding container 46260b99c84512b3dd515854748c54ad74c052d32baf01b7e3c8bdd05164acfb: Status 404 returned error can't find the container with id 46260b99c84512b3dd515854748c54ad74c052d32baf01b7e3c8bdd05164acfb Jul 08 16:11:51.970461 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:51.970418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hpgmz" event={"ID":"1f11b7cd-780d-4b9b-9976-7b6c546f8b85","Type":"ContainerStarted","Data":"c16635154e1d15d3120ee67ddac5912a40e34648a3001553787c34c46fcb0915"} Jul 08 16:11:51.971694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:51.971671 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wn2gf" event={"ID":"e8cef542-9b82-42ca-b72e-6c85920e7173","Type":"ContainerStarted","Data":"46260b99c84512b3dd515854748c54ad74c052d32baf01b7e3c8bdd05164acfb"} Jul 08 16:11:57.006424 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.006382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hpgmz" event={"ID":"1f11b7cd-780d-4b9b-9976-7b6c546f8b85","Type":"ContainerStarted","Data":"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901"} Jul 08 16:11:57.007985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.007959 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" event={"ID":"c7ecc364-1133-4aca-83a3-175c8e5162c0","Type":"ContainerStarted","Data":"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff"} Jul 08 16:11:57.008131 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.008056 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:11:57.009357 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.009337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wn2gf" event={"ID":"e8cef542-9b82-42ca-b72e-6c85920e7173","Type":"ContainerStarted","Data":"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca"} Jul 08 16:11:57.066440 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.066286 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" podStartSLOduration=2.195454427 podStartE2EDuration="8.066262264s" totalImagesPullingTime="5.870807837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:57.06547264 +0000 UTC m=+488.647345151" watchObservedRunningTime="2026-07-08 16:11:57.066262264 +0000 UTC m=+488.648134776" Jul 08 16:11:57.067456 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.067412 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hpgmz" podStartSLOduration=2.106978608 podStartE2EDuration="7.067399296s" totalImagesPullingTime="4.960420688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:57.034125573 +0000 UTC m=+488.615998084" watchObservedRunningTime="2026-07-08 16:11:57.067399296 +0000 UTC m=+488.649271810" Jul 08 16:11:57.091675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.091614 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wn2gf" podStartSLOduration=2.329381729 podStartE2EDuration="7.091597385s" totalImagesPullingTime="4.762215656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:11:57.089800413 +0000 UTC m=+488.671672933" watchObservedRunningTime="2026-07-08 16:11:57.091597385 +0000 UTC m=+488.673469895" Jul 08 16:11:57.141959 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:57.141910 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:11:59.020626 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:59.020583 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hpgmz" podUID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" containerName="authorino" containerID="cri-o://69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901" gracePeriod=30 Jul 08 16:11:59.279720 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:59.279654 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:11:59.334835 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:59.334794 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knvn8\" (UniqueName: \"kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8\") pod \"1f11b7cd-780d-4b9b-9976-7b6c546f8b85\" (UID: \"1f11b7cd-780d-4b9b-9976-7b6c546f8b85\") " Jul 08 16:11:59.336925 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:59.336897 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8" (OuterVolumeSpecName: "kube-api-access-knvn8") pod "1f11b7cd-780d-4b9b-9976-7b6c546f8b85" (UID: "1f11b7cd-780d-4b9b-9976-7b6c546f8b85"). InnerVolumeSpecName "kube-api-access-knvn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:11:59.435561 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:11:59.435517 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knvn8\" (UniqueName: \"kubernetes.io/projected/1f11b7cd-780d-4b9b-9976-7b6c546f8b85-kube-api-access-knvn8\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:00.027538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.027505 2572 generic.go:356] "Generic (PLEG): container finished" podID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" containerID="69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901" exitCode=0 Jul 08 16:12:00.028028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.027551 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hpgmz" Jul 08 16:12:00.028028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.027597 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hpgmz" event={"ID":"1f11b7cd-780d-4b9b-9976-7b6c546f8b85","Type":"ContainerDied","Data":"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901"} Jul 08 16:12:00.028028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.027638 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hpgmz" event={"ID":"1f11b7cd-780d-4b9b-9976-7b6c546f8b85","Type":"ContainerDied","Data":"c16635154e1d15d3120ee67ddac5912a40e34648a3001553787c34c46fcb0915"} Jul 08 16:12:00.028028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.027658 2572 scope.go:117] "RemoveContainer" containerID="69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901" Jul 08 16:12:00.037275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.037260 2572 scope.go:117] "RemoveContainer" containerID="69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901" Jul 08 16:12:00.037510 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:12:00.037495 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901\": container with ID starting with 69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901 not found: ID does not exist" containerID="69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901" Jul 08 16:12:00.037553 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.037519 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901"} err="failed to get container status \"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901\": rpc error: code = NotFound desc = could not find container \"69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901\": container with ID starting with 69333eb1ac08f592683888b5a4d2dfb66547bb3632cad2e73642a4b55fc3e901 not found: ID does not exist" Jul 08 16:12:00.048940 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.048916 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:12:00.053989 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.053958 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hpgmz"] Jul 08 16:12:00.470831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:00.470798 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" path="/var/lib/kubelet/pods/1f11b7cd-780d-4b9b-9976-7b6c546f8b85/volumes" Jul 08 16:12:04.341980 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.341939 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:12:04.342453 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.342156 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" podUID="c7ecc364-1133-4aca-83a3-175c8e5162c0" containerName="limitador" containerID="cri-o://a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff" gracePeriod=30 Jul 08 16:12:04.344668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.344637 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:12:04.894192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.894160 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:12:04.985899 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.985844 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file\") pod \"c7ecc364-1133-4aca-83a3-175c8e5162c0\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " Jul 08 16:12:04.986115 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.985991 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9zlc\" (UniqueName: \"kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc\") pod \"c7ecc364-1133-4aca-83a3-175c8e5162c0\" (UID: \"c7ecc364-1133-4aca-83a3-175c8e5162c0\") " Jul 08 16:12:04.986275 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.986251 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file" (OuterVolumeSpecName: "config-file") pod "c7ecc364-1133-4aca-83a3-175c8e5162c0" (UID: "c7ecc364-1133-4aca-83a3-175c8e5162c0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:12:04.988089 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:04.988065 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc" (OuterVolumeSpecName: "kube-api-access-t9zlc") pod "c7ecc364-1133-4aca-83a3-175c8e5162c0" (UID: "c7ecc364-1133-4aca-83a3-175c8e5162c0"). InnerVolumeSpecName "kube-api-access-t9zlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:12:05.056514 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.056480 2572 generic.go:356] "Generic (PLEG): container finished" podID="c7ecc364-1133-4aca-83a3-175c8e5162c0" containerID="a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff" exitCode=0 Jul 08 16:12:05.056687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.056525 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" Jul 08 16:12:05.056687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.056537 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" event={"ID":"c7ecc364-1133-4aca-83a3-175c8e5162c0","Type":"ContainerDied","Data":"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff"} Jul 08 16:12:05.056687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.056578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-g8vrk" event={"ID":"c7ecc364-1133-4aca-83a3-175c8e5162c0","Type":"ContainerDied","Data":"f735ca3858c1703b28b5c3af0e7aa444d8471e5ee9ad1221bdcbebba422b73ac"} Jul 08 16:12:05.056687 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.056601 2572 scope.go:117] "RemoveContainer" containerID="a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff" Jul 08 16:12:05.066575 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.066548 2572 scope.go:117] "RemoveContainer" containerID="a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff" Jul 08 16:12:05.066871 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:12:05.066850 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff\": container with ID starting with a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff not found: ID does not exist" containerID="a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff" Jul 08 16:12:05.066951 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.066883 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff"} err="failed to get container status \"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff\": rpc error: code = NotFound desc = could not find container \"a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff\": container with ID starting with a6fd9e7c28b9d79fcda536ccbb85a6981bbaa91156c1d030751b7ba5fb3fb5ff not found: ID does not exist" Jul 08 16:12:05.080144 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.080109 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:12:05.086992 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.086962 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9zlc\" (UniqueName: \"kubernetes.io/projected/c7ecc364-1133-4aca-83a3-175c8e5162c0-kube-api-access-t9zlc\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:05.086992 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.086993 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c7ecc364-1133-4aca-83a3-175c8e5162c0-config-file\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:05.088970 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.088949 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-g8vrk"] Jul 08 16:12:05.602636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:05.602595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:06.471519 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:06.471486 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ecc364-1133-4aca-83a3-175c8e5162c0" path="/var/lib/kubelet/pods/c7ecc364-1133-4aca-83a3-175c8e5162c0/volumes" Jul 08 16:12:10.264425 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.264390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:10.369729 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.369697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:10.706535 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.706502 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jz25f"] Jul 08 16:12:10.706962 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.706946 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" containerName="authorino" Jul 08 16:12:10.707015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.706964 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" containerName="authorino" Jul 08 16:12:10.707015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.706986 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ecc364-1133-4aca-83a3-175c8e5162c0" containerName="limitador" Jul 08 16:12:10.707015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.706993 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ecc364-1133-4aca-83a3-175c8e5162c0" containerName="limitador" Jul 08 16:12:10.707144 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.707095 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f11b7cd-780d-4b9b-9976-7b6c546f8b85" containerName="authorino" Jul 08 16:12:10.707144 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.707116 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ecc364-1133-4aca-83a3-175c8e5162c0" containerName="limitador" Jul 08 16:12:10.711135 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.711115 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.713990 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.713966 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 16:12:10.714124 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.714017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 16:12:10.715120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.715092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 16:12:10.715272 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.715145 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6zw6r\"" Jul 08 16:12:10.718258 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.718236 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jz25f"] Jul 08 16:12:10.746060 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.746012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:10.840247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.840204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76v5f\" (UniqueName: \"kubernetes.io/projected/358126a2-c454-4e07-91b7-9a8e8f3f4e62-kube-api-access-76v5f\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.840247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.840249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/358126a2-c454-4e07-91b7-9a8e8f3f4e62-data\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.941541 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.941498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76v5f\" (UniqueName: \"kubernetes.io/projected/358126a2-c454-4e07-91b7-9a8e8f3f4e62-kube-api-access-76v5f\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.941541 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.941542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/358126a2-c454-4e07-91b7-9a8e8f3f4e62-data\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.941944 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.941927 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/358126a2-c454-4e07-91b7-9a8e8f3f4e62-data\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:10.952383 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:10.952351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76v5f\" (UniqueName: \"kubernetes.io/projected/358126a2-c454-4e07-91b7-9a8e8f3f4e62-kube-api-access-76v5f\") pod \"postgres-69fb4594cf-jz25f\" (UID: \"358126a2-c454-4e07-91b7-9a8e8f3f4e62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:11.027812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:11.027716 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:11.170086 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:11.170029 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jz25f"] Jul 08 16:12:11.171583 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:12:11.171550 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358126a2_c454_4e07_91b7_9a8e8f3f4e62.slice/crio-d5a242fc743ea25d91a6b3730457ee0127915633e1efc4cd7ad8ae42d09b08a5 WatchSource:0}: Error finding container d5a242fc743ea25d91a6b3730457ee0127915633e1efc4cd7ad8ae42d09b08a5: Status 404 returned error can't find the container with id d5a242fc743ea25d91a6b3730457ee0127915633e1efc4cd7ad8ae42d09b08a5 Jul 08 16:12:12.104366 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:12.104278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" event={"ID":"358126a2-c454-4e07-91b7-9a8e8f3f4e62","Type":"ContainerStarted","Data":"d5a242fc743ea25d91a6b3730457ee0127915633e1efc4cd7ad8ae42d09b08a5"} Jul 08 16:12:16.135953 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:16.135912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" event={"ID":"358126a2-c454-4e07-91b7-9a8e8f3f4e62","Type":"ContainerStarted","Data":"ce061e54e922f9c5f2cdaf4eba5fb29a3571145f6a0272cbb58a2de0b5ce3cf1"} Jul 08 16:12:16.136363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:16.136026 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:16.178304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:16.178246 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" podStartSLOduration=1.402382745 podStartE2EDuration="6.178228066s" totalImagesPullingTime="4.775845321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:12:16.176482656 +0000 UTC m=+507.758355196" watchObservedRunningTime="2026-07-08 16:12:16.178228066 +0000 UTC m=+507.760100576" Jul 08 16:12:22.172184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.172147 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jz25f" Jul 08 16:12:22.499848 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.499750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:22.760701 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.760609 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:22.767136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.767107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:22.769085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.769059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:22.833188 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.833158 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:22.851432 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.851389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mstj\" (UniqueName: \"kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj\") pod \"authorino-5d4b67c446-z22bq\" (UID: \"5348e89b-bf74-4780-af9d-e60ddc936956\") " pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:22.952418 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.952377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mstj\" (UniqueName: \"kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj\") pod \"authorino-5d4b67c446-z22bq\" (UID: \"5348e89b-bf74-4780-af9d-e60ddc936956\") " pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:22.965985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:22.965957 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mstj\" (UniqueName: \"kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj\") pod \"authorino-5d4b67c446-z22bq\" (UID: \"5348e89b-bf74-4780-af9d-e60ddc936956\") " pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:23.020948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.020852 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:23.021175 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.021160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:23.044224 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.044193 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:12:23.049633 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.049606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.052473 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.052452 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 16:12:23.052820 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.052797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.052927 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.052909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf4m7\" (UniqueName: \"kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.057892 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.057862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:12:23.153917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.153889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf4m7\" (UniqueName: \"kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.154101 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.153979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.156506 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.156478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.162538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.162509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf4m7\" (UniqueName: \"kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7\") pod \"authorino-674fc487f4-hxpx6\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.167556 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.167536 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:23.169300 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:12:23.169277 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5348e89b_bf74_4780_af9d_e60ddc936956.slice/crio-8241728ef113cdb3fbdc9bb2a797b0bd11acde53a6554165c5986c2f5692e615 WatchSource:0}: Error finding container 8241728ef113cdb3fbdc9bb2a797b0bd11acde53a6554165c5986c2f5692e615: Status 404 returned error can't find the container with id 8241728ef113cdb3fbdc9bb2a797b0bd11acde53a6554165c5986c2f5692e615 Jul 08 16:12:23.177768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.177744 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z22bq" event={"ID":"5348e89b-bf74-4780-af9d-e60ddc936956","Type":"ContainerStarted","Data":"8241728ef113cdb3fbdc9bb2a797b0bd11acde53a6554165c5986c2f5692e615"} Jul 08 16:12:23.361145 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.361019 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:12:23.499975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:23.499943 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:12:23.502468 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:12:23.502440 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7572f68e_8e05_4e8f_a944_a49f056f481b.slice/crio-e22a86b9b63ad60f36ff332b9dc5956448a7993e430a92b87e96855ae2a6ccd9 WatchSource:0}: Error finding container e22a86b9b63ad60f36ff332b9dc5956448a7993e430a92b87e96855ae2a6ccd9: Status 404 returned error can't find the container with id e22a86b9b63ad60f36ff332b9dc5956448a7993e430a92b87e96855ae2a6ccd9 Jul 08 16:12:24.184965 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.184927 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674fc487f4-hxpx6" event={"ID":"7572f68e-8e05-4e8f-a944-a49f056f481b","Type":"ContainerStarted","Data":"e22a86b9b63ad60f36ff332b9dc5956448a7993e430a92b87e96855ae2a6ccd9"} Jul 08 16:12:24.186429 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.186396 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z22bq" event={"ID":"5348e89b-bf74-4780-af9d-e60ddc936956","Type":"ContainerStarted","Data":"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6"} Jul 08 16:12:24.186544 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.186476 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-z22bq" podUID="5348e89b-bf74-4780-af9d-e60ddc936956" containerName="authorino" containerID="cri-o://68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6" gracePeriod=30 Jul 08 16:12:24.201977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.201918 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-z22bq" podStartSLOduration=1.819816791 podStartE2EDuration="2.201893311s" totalImagesPullingTime="382.07652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:12:24.20117041 +0000 UTC m=+515.783042921" watchObservedRunningTime="2026-07-08 16:12:24.201893311 +0000 UTC m=+515.783765822" Jul 08 16:12:24.453237 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.453209 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:24.465975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.465942 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mstj\" (UniqueName: \"kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj\") pod \"5348e89b-bf74-4780-af9d-e60ddc936956\" (UID: \"5348e89b-bf74-4780-af9d-e60ddc936956\") " Jul 08 16:12:24.467997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.467966 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj" (OuterVolumeSpecName: "kube-api-access-9mstj") pod "5348e89b-bf74-4780-af9d-e60ddc936956" (UID: "5348e89b-bf74-4780-af9d-e60ddc936956"). InnerVolumeSpecName "kube-api-access-9mstj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:12:24.567214 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:24.567171 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mstj\" (UniqueName: \"kubernetes.io/projected/5348e89b-bf74-4780-af9d-e60ddc936956-kube-api-access-9mstj\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:25.193317 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.193279 2572 generic.go:356] "Generic (PLEG): container finished" podID="5348e89b-bf74-4780-af9d-e60ddc936956" containerID="68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6" exitCode=0 Jul 08 16:12:25.193760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.193322 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z22bq" Jul 08 16:12:25.193760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.193365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z22bq" event={"ID":"5348e89b-bf74-4780-af9d-e60ddc936956","Type":"ContainerDied","Data":"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6"} Jul 08 16:12:25.193760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.193410 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-z22bq" event={"ID":"5348e89b-bf74-4780-af9d-e60ddc936956","Type":"ContainerDied","Data":"8241728ef113cdb3fbdc9bb2a797b0bd11acde53a6554165c5986c2f5692e615"} Jul 08 16:12:25.193760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.193431 2572 scope.go:117] "RemoveContainer" containerID="68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6" Jul 08 16:12:25.195437 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.195409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674fc487f4-hxpx6" event={"ID":"7572f68e-8e05-4e8f-a944-a49f056f481b","Type":"ContainerStarted","Data":"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a"} Jul 08 16:12:25.202716 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.202697 2572 scope.go:117] "RemoveContainer" containerID="68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6" Jul 08 16:12:25.203017 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:12:25.202997 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6\": container with ID starting with 68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6 not found: ID does not exist" containerID="68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6" Jul 08 16:12:25.203085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.203025 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6"} err="failed to get container status \"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6\": rpc error: code = NotFound desc = could not find container \"68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6\": container with ID starting with 68e96e8887ac279a0f39f0d5a38d11d364b8958211fd65eea1999b0dff88b2a6 not found: ID does not exist" Jul 08 16:12:25.211594 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.211566 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:25.215896 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.215871 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z22bq"] Jul 08 16:12:25.231338 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.231239 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-674fc487f4-hxpx6" podStartSLOduration=1.521147617 podStartE2EDuration="2.231221594s" totalImagesPullingTime="710.073977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:12:25.228817385 +0000 UTC m=+516.810689897" watchObservedRunningTime="2026-07-08 16:12:25.231221594 +0000 UTC m=+516.813094114" Jul 08 16:12:25.256886 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.256850 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:12:25.257089 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.257065 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wn2gf" podUID="e8cef542-9b82-42ca-b72e-6c85920e7173" containerName="authorino" containerID="cri-o://0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca" gracePeriod=30 Jul 08 16:12:25.542363 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.542310 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:12:25.575077 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.575027 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj7h4\" (UniqueName: \"kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4\") pod \"e8cef542-9b82-42ca-b72e-6c85920e7173\" (UID: \"e8cef542-9b82-42ca-b72e-6c85920e7173\") " Jul 08 16:12:25.577120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.577096 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4" (OuterVolumeSpecName: "kube-api-access-lj7h4") pod "e8cef542-9b82-42ca-b72e-6c85920e7173" (UID: "e8cef542-9b82-42ca-b72e-6c85920e7173"). InnerVolumeSpecName "kube-api-access-lj7h4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:12:25.675871 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:25.675834 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj7h4\" (UniqueName: \"kubernetes.io/projected/e8cef542-9b82-42ca-b72e-6c85920e7173-kube-api-access-lj7h4\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:26.206428 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.206388 2572 generic.go:356] "Generic (PLEG): container finished" podID="e8cef542-9b82-42ca-b72e-6c85920e7173" containerID="0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca" exitCode=0 Jul 08 16:12:26.206428 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.206424 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wn2gf" Jul 08 16:12:26.206994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.206620 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wn2gf" event={"ID":"e8cef542-9b82-42ca-b72e-6c85920e7173","Type":"ContainerDied","Data":"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca"} Jul 08 16:12:26.206994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.206733 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wn2gf" event={"ID":"e8cef542-9b82-42ca-b72e-6c85920e7173","Type":"ContainerDied","Data":"46260b99c84512b3dd515854748c54ad74c052d32baf01b7e3c8bdd05164acfb"} Jul 08 16:12:26.206994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.206764 2572 scope.go:117] "RemoveContainer" containerID="0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca" Jul 08 16:12:26.218562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.218440 2572 scope.go:117] "RemoveContainer" containerID="0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca" Jul 08 16:12:26.219608 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:12:26.219570 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca\": container with ID starting with 0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca not found: ID does not exist" containerID="0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca" Jul 08 16:12:26.219745 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.219619 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca"} err="failed to get container status \"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca\": rpc error: code = NotFound desc = could not find container \"0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca\": container with ID starting with 0b5c705aa46cfb9fc4c20d082d8d3e6fbd45c685fa3e1a3e0d9c70e80d82a7ca not found: ID does not exist" Jul 08 16:12:26.235467 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.235415 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:12:26.239615 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.239587 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wn2gf"] Jul 08 16:12:26.471202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.471124 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5348e89b-bf74-4780-af9d-e60ddc936956" path="/var/lib/kubelet/pods/5348e89b-bf74-4780-af9d-e60ddc936956/volumes" Jul 08 16:12:26.471485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:26.471470 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8cef542-9b82-42ca-b72e-6c85920e7173" path="/var/lib/kubelet/pods/e8cef542-9b82-42ca-b72e-6c85920e7173/volumes" Jul 08 16:12:29.765257 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765217 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:29.765636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765604 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8cef542-9b82-42ca-b72e-6c85920e7173" containerName="authorino" Jul 08 16:12:29.765636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765619 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8cef542-9b82-42ca-b72e-6c85920e7173" containerName="authorino" Jul 08 16:12:29.765636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765634 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5348e89b-bf74-4780-af9d-e60ddc936956" containerName="authorino" Jul 08 16:12:29.765736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765640 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5348e89b-bf74-4780-af9d-e60ddc936956" containerName="authorino" Jul 08 16:12:29.765736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765708 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8cef542-9b82-42ca-b72e-6c85920e7173" containerName="authorino" Jul 08 16:12:29.765736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.765717 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5348e89b-bf74-4780-af9d-e60ddc936956" containerName="authorino" Jul 08 16:12:29.770025 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.769995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:29.870487 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:29.870452 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:30.003092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.003027 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:30.003288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.003111 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:12:30.003288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.003137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.006645 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.006622 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 16:12:30.006785 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.006630 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 16:12:30.006785 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.006757 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9l52v\"" Jul 08 16:12:30.024602 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.024532 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:12:30.024728 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.024625 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.116232 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.116192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.116420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.116305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.116420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.116348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7fl2\" (UniqueName: \"kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.116420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.116378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkxm\" (UniqueName: \"kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.217876 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.217837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.218028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.217928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.218028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.217959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7fl2\" (UniqueName: \"kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.218028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.217987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkxm\" (UniqueName: \"kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.220477 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.220449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.220595 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.220449 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.237178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.237152 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkxm\" (UniqueName: \"kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm\") pod \"maas-controller-d884f6456-spn29\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.241223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.241205 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7fl2\" (UniqueName: \"kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2\") pod \"maas-controller-6c4648649c-jnbtc\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.312664 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.312568 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:30.334262 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.334235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:30.459810 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.459749 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:30.460342 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:12:30.460315 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd21fb4_0168_4614_bcf3_2c5b27456e8c.slice/crio-d788fea1978802d6e28d23dded6e494d2239262674ae35bf85c5192a3129367e WatchSource:0}: Error finding container d788fea1978802d6e28d23dded6e494d2239262674ae35bf85c5192a3129367e: Status 404 returned error can't find the container with id d788fea1978802d6e28d23dded6e494d2239262674ae35bf85c5192a3129367e Jul 08 16:12:30.484328 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:30.484198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:12:30.487142 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:12:30.487117 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638bbc4b_9eef_429b_bf2f_ed29b8cd6e39.slice/crio-4a7e40e5abd8f9962956af5b5de1d65abea423553327ffe24bddf3f68186e621 WatchSource:0}: Error finding container 4a7e40e5abd8f9962956af5b5de1d65abea423553327ffe24bddf3f68186e621: Status 404 returned error can't find the container with id 4a7e40e5abd8f9962956af5b5de1d65abea423553327ffe24bddf3f68186e621 Jul 08 16:12:31.246112 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:31.245987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-spn29" event={"ID":"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39","Type":"ContainerStarted","Data":"4a7e40e5abd8f9962956af5b5de1d65abea423553327ffe24bddf3f68186e621"} Jul 08 16:12:31.251399 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:31.251291 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4648649c-jnbtc" event={"ID":"7dd21fb4-0168-4614-bcf3-2c5b27456e8c","Type":"ContainerStarted","Data":"d788fea1978802d6e28d23dded6e494d2239262674ae35bf85c5192a3129367e"} Jul 08 16:12:32.923276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:32.923243 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:33.029764 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.029721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:12:33.263562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.263444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-spn29" event={"ID":"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39","Type":"ContainerStarted","Data":"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f"} Jul 08 16:12:33.263562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.263520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:33.265289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.265263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4648649c-jnbtc" event={"ID":"7dd21fb4-0168-4614-bcf3-2c5b27456e8c","Type":"ContainerStarted","Data":"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68"} Jul 08 16:12:33.265425 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.265351 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:33.287304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.287252 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d884f6456-spn29" podStartSLOduration=2.104674751 podStartE2EDuration="4.287238004s" totalImagesPullingTime="2.182563253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:12:33.285670864 +0000 UTC m=+524.867543405" watchObservedRunningTime="2026-07-08 16:12:33.287238004 +0000 UTC m=+524.869110515" Jul 08 16:12:33.308784 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:33.308732 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c4648649c-jnbtc" podStartSLOduration=2.106220907 podStartE2EDuration="4.308715898s" totalImagesPullingTime="2.202494991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:12:33.304967358 +0000 UTC m=+524.886839891" watchObservedRunningTime="2026-07-08 16:12:33.308715898 +0000 UTC m=+524.890588408" Jul 08 16:12:44.277356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.277267 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:12:44.277356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.277350 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:44.341360 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.341325 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:44.341604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.341558 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c4648649c-jnbtc" podUID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" containerName="manager" containerID="cri-o://b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68" gracePeriod=30 Jul 08 16:12:44.600116 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.600086 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:44.755238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.755193 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7fl2\" (UniqueName: \"kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2\") pod \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " Jul 08 16:12:44.755449 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.755312 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert\") pod \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\" (UID: \"7dd21fb4-0168-4614-bcf3-2c5b27456e8c\") " Jul 08 16:12:44.757390 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.757358 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2" (OuterVolumeSpecName: "kube-api-access-v7fl2") pod "7dd21fb4-0168-4614-bcf3-2c5b27456e8c" (UID: "7dd21fb4-0168-4614-bcf3-2c5b27456e8c"). InnerVolumeSpecName "kube-api-access-v7fl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:12:44.757504 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.757387 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7dd21fb4-0168-4614-bcf3-2c5b27456e8c" (UID: "7dd21fb4-0168-4614-bcf3-2c5b27456e8c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:12:44.856837 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.856740 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-webhook-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:44.856837 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:44.856777 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7fl2\" (UniqueName: \"kubernetes.io/projected/7dd21fb4-0168-4614-bcf3-2c5b27456e8c-kube-api-access-v7fl2\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:12:45.332795 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.332763 2572 generic.go:356] "Generic (PLEG): container finished" podID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" containerID="b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68" exitCode=0 Jul 08 16:12:45.333290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.332819 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c4648649c-jnbtc" Jul 08 16:12:45.333290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.332853 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4648649c-jnbtc" event={"ID":"7dd21fb4-0168-4614-bcf3-2c5b27456e8c","Type":"ContainerDied","Data":"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68"} Jul 08 16:12:45.333290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.332929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c4648649c-jnbtc" event={"ID":"7dd21fb4-0168-4614-bcf3-2c5b27456e8c","Type":"ContainerDied","Data":"d788fea1978802d6e28d23dded6e494d2239262674ae35bf85c5192a3129367e"} Jul 08 16:12:45.333290 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.332954 2572 scope.go:117] "RemoveContainer" containerID="b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68" Jul 08 16:12:45.342817 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.342666 2572 scope.go:117] "RemoveContainer" containerID="b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68" Jul 08 16:12:45.342947 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:12:45.342931 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68\": container with ID starting with b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68 not found: ID does not exist" containerID="b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68" Jul 08 16:12:45.342996 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.342953 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68"} err="failed to get container status \"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68\": rpc error: code = NotFound desc = could not find container \"b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68\": container with ID starting with b1181f87ec6c3714bb64781423fc865a3d284b3b2a700baa110f4882d755bc68 not found: ID does not exist" Jul 08 16:12:45.355618 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.355584 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:45.359692 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:45.359666 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c4648649c-jnbtc"] Jul 08 16:12:46.471497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:12:46.471465 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" path="/var/lib/kubelet/pods/7dd21fb4-0168-4614-bcf3-2c5b27456e8c/volumes" Jul 08 16:13:03.075399 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.075358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:03.609415 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.609381 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:03.675132 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.675085 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b"] Jul 08 16:13:03.675547 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.675532 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" containerName="manager" Jul 08 16:13:03.675610 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.675550 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" containerName="manager" Jul 08 16:13:03.675651 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.675618 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd21fb4-0168-4614-bcf3-2c5b27456e8c" containerName="manager" Jul 08 16:13:03.680360 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.680321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.683474 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.683452 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 08 16:13:03.684562 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.684538 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vpl4l\"" Jul 08 16:13:03.685174 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.685147 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b"] Jul 08 16:13:03.708760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.708727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:03.729219 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.729181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq75p\" (UniqueName: \"kubernetes.io/projected/e0f8dcf1-cfb5-44da-94c7-6770f1034056-kube-api-access-xq75p\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.729385 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.729286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f8dcf1-cfb5-44da-94c7-6770f1034056-maas-api-tls\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.729385 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.729351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f8dcf1-cfb5-44da-94c7-6770f1034056-openshift-service-ca\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.830203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.830165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f8dcf1-cfb5-44da-94c7-6770f1034056-maas-api-tls\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.830203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.830211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f8dcf1-cfb5-44da-94c7-6770f1034056-openshift-service-ca\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.830427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.830241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq75p\" (UniqueName: \"kubernetes.io/projected/e0f8dcf1-cfb5-44da-94c7-6770f1034056-kube-api-access-xq75p\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.830849 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.830830 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f8dcf1-cfb5-44da-94c7-6770f1034056-openshift-service-ca\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.832621 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.832595 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0f8dcf1-cfb5-44da-94c7-6770f1034056-maas-api-tls\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.841431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.841410 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq75p\" (UniqueName: \"kubernetes.io/projected/e0f8dcf1-cfb5-44da-94c7-6770f1034056-kube-api-access-xq75p\") pod \"maas-api-6c6d949986-hgt9b\" (UID: \"e0f8dcf1-cfb5-44da-94c7-6770f1034056\") " pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:03.993848 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:03.993808 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:04.113120 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.113072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:04.140597 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.140573 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b"] Jul 08 16:13:04.142982 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:13:04.142953 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f8dcf1_cfb5_44da_94c7_6770f1034056.slice/crio-959e98d102f55d9338946074041f67483cd3a946ae68cfcc437674f5bd5e2698 WatchSource:0}: Error finding container 959e98d102f55d9338946074041f67483cd3a946ae68cfcc437674f5bd5e2698: Status 404 returned error can't find the container with id 959e98d102f55d9338946074041f67483cd3a946ae68cfcc437674f5bd5e2698 Jul 08 16:13:04.212772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.212738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:04.251289 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.251196 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t5fhm"] Jul 08 16:13:04.256444 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.256421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.259304 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.259283 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pqkmg\"" Jul 08 16:13:04.259435 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.259306 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 16:13:04.263516 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.263492 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t5fhm"] Jul 08 16:13:04.335568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.335522 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m77b\" (UniqueName: \"kubernetes.io/projected/74e34c38-70d4-4242-9db2-f88eff45adb7-kube-api-access-4m77b\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.335738 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.335699 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e34c38-70d4-4242-9db2-f88eff45adb7-plugins-config-volume\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.437286 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.437246 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e34c38-70d4-4242-9db2-f88eff45adb7-plugins-config-volume\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.437482 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.437311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m77b\" (UniqueName: \"kubernetes.io/projected/74e34c38-70d4-4242-9db2-f88eff45adb7-kube-api-access-4m77b\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.438171 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.438147 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74e34c38-70d4-4242-9db2-f88eff45adb7-plugins-config-volume\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.442484 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.442452 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" event={"ID":"e0f8dcf1-cfb5-44da-94c7-6770f1034056","Type":"ContainerStarted","Data":"959e98d102f55d9338946074041f67483cd3a946ae68cfcc437674f5bd5e2698"} Jul 08 16:13:04.447612 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.447581 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m77b\" (UniqueName: \"kubernetes.io/projected/74e34c38-70d4-4242-9db2-f88eff45adb7-kube-api-access-4m77b\") pod \"payload-processing-58f86c7798-t5fhm\" (UID: \"74e34c38-70d4-4242-9db2-f88eff45adb7\") " pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.569470 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.569376 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:04.720182 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:04.720152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-t5fhm"] Jul 08 16:13:04.721788 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:13:04.721758 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e34c38_70d4_4242_9db2_f88eff45adb7.slice/crio-dc419615ca8586f022f72b4e0e5c62fda94e6f2788d04fae373799818c627d60 WatchSource:0}: Error finding container dc419615ca8586f022f72b4e0e5c62fda94e6f2788d04fae373799818c627d60: Status 404 returned error can't find the container with id dc419615ca8586f022f72b4e0e5c62fda94e6f2788d04fae373799818c627d60 Jul 08 16:13:05.467757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:05.467722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" event={"ID":"74e34c38-70d4-4242-9db2-f88eff45adb7","Type":"ContainerStarted","Data":"dc419615ca8586f022f72b4e0e5c62fda94e6f2788d04fae373799818c627d60"} Jul 08 16:13:07.481808 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.481767 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" event={"ID":"74e34c38-70d4-4242-9db2-f88eff45adb7","Type":"ContainerStarted","Data":"6f804570f36a84b4ab43db6532b6a07f3b429647124b17e0d6bd688ede43fa54"} Jul 08 16:13:07.482301 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.481889 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:07.483519 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.483491 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" event={"ID":"e0f8dcf1-cfb5-44da-94c7-6770f1034056","Type":"ContainerStarted","Data":"7fc55335f1b3fb044489418ebc4ef616a96deaaa9c0c2f29e65d319b19b49e92"} Jul 08 16:13:07.483636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.483540 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:07.500983 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.500918 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" podStartSLOduration=1.489743459 podStartE2EDuration="3.500901259s" totalImagesPullingTime="2.0111578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:13:07.499681089 +0000 UTC m=+559.081553614" watchObservedRunningTime="2026-07-08 16:13:07.500901259 +0000 UTC m=+559.082773770" Jul 08 16:13:07.519769 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:07.519716 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" podStartSLOduration=1.9319475050000001 podStartE2EDuration="4.519700263s" totalImagesPullingTime="2.587752758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:13:07.51843833 +0000 UTC m=+559.100310855" watchObservedRunningTime="2026-07-08 16:13:07.519700263 +0000 UTC m=+559.101572774" Jul 08 16:13:12.515473 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.515436 2572 generic.go:356] "Generic (PLEG): container finished" podID="d46a042e-f294-47e4-81ed-31a07a6e65e9" containerID="2d6b1cdd9c265c7e079e21febb4f0f036999693146c892ae8d72d9d10f18edb4" exitCode=0 Jul 08 16:13:12.515910 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.515511 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" event={"ID":"d46a042e-f294-47e4-81ed-31a07a6e65e9","Type":"ContainerDied","Data":"2d6b1cdd9c265c7e079e21febb4f0f036999693146c892ae8d72d9d10f18edb4"} Jul 08 16:13:12.515910 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.515904 2572 scope.go:117] "RemoveContainer" containerID="2d6b1cdd9c265c7e079e21febb4f0f036999693146c892ae8d72d9d10f18edb4" Jul 08 16:13:12.516870 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.516843 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:13:12.516919 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.516910 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:13:12.516964 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:12.516942 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:13:13.494917 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:13.494883 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c6d949986-hgt9b" Jul 08 16:13:13.524706 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:13.524667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" event={"ID":"d46a042e-f294-47e4-81ed-31a07a6e65e9","Type":"ContainerStarted","Data":"f3c2f7bef9b394afc9ef908b7e00216f428568704e0ca24bc76efcfadb5e5018"} Jul 08 16:13:13.626914 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:13.626879 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:13:13.627139 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:13.627105 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8jjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 08 16:13:13.627204 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:13.627166 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" podUID="d46a042e-f294-47e4-81ed-31a07a6e65e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 08 16:13:14.501649 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:14.501613 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:14.600107 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:14.600072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:14.627102 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:14.627066 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8jjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 08 16:13:14.627269 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:14.627139 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" podUID="d46a042e-f294-47e4-81ed-31a07a6e65e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 08 16:13:15.627235 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:15.627194 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8jjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 08 16:13:15.627629 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:15.627255 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" podUID="d46a042e-f294-47e4-81ed-31a07a6e65e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 08 16:13:16.627001 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:16.626967 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8jjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 08 16:13:16.627252 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:16.627067 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" podUID="d46a042e-f294-47e4-81ed-31a07a6e65e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 08 16:13:17.630845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:17.630814 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:13:17.631265 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:17.631102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:13:17.631765 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:17.631746 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8jjct" Jul 08 16:13:18.492190 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:18.492153 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-t5fhm" Jul 08 16:13:22.554777 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:22.554738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:26.605736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:26.605697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:26.723758 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:26.723722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:37.201217 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.201167 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n"] Jul 08 16:13:37.205775 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.205744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.210262 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.210235 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 16:13:37.210420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.210272 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 16:13:37.210420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.210235 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t6v4q\"" Jul 08 16:13:37.210420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.210239 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 16:13:37.215613 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.215587 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n"] Jul 08 16:13:37.306319 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.306286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:37.358472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358431 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.358472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.358680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358543 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.358680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.358680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360e621b-4123-4d31-a82d-36667cbf2f7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.358680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.358663 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dlg\" (UniqueName: \"kubernetes.io/projected/360e621b-4123-4d31-a82d-36667cbf2f7a-kube-api-access-w7dlg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360e621b-4123-4d31-a82d-36667cbf2f7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459537 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dlg\" (UniqueName: \"kubernetes.io/projected/360e621b-4123-4d31-a82d-36667cbf2f7a-kube-api-access-w7dlg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.459773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.459707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.460061 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.460004 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.460145 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.460082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.460206 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.460182 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.461886 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.461865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360e621b-4123-4d31-a82d-36667cbf2f7a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.461966 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.461895 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360e621b-4123-4d31-a82d-36667cbf2f7a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.468748 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.468720 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dlg\" (UniqueName: \"kubernetes.io/projected/360e621b-4123-4d31-a82d-36667cbf2f7a-kube-api-access-w7dlg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-rfg4n\" (UID: \"360e621b-4123-4d31-a82d-36667cbf2f7a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.516812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.516774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:37.652246 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.652216 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n"] Jul 08 16:13:37.654253 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:13:37.654227 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360e621b_4123_4d31_a82d_36667cbf2f7a.slice/crio-61af9b6ef0c3370c3e4845f2ab5dd89f284aa2abc2519dc5d9ed9d411ab344c1 WatchSource:0}: Error finding container 61af9b6ef0c3370c3e4845f2ab5dd89f284aa2abc2519dc5d9ed9d411ab344c1: Status 404 returned error can't find the container with id 61af9b6ef0c3370c3e4845f2ab5dd89f284aa2abc2519dc5d9ed9d411ab344c1 Jul 08 16:13:37.665773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:37.665745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" event={"ID":"360e621b-4123-4d31-a82d-36667cbf2f7a","Type":"ContainerStarted","Data":"61af9b6ef0c3370c3e4845f2ab5dd89f284aa2abc2519dc5d9ed9d411ab344c1"} Jul 08 16:13:39.678566 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:39.678532 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" event={"ID":"360e621b-4123-4d31-a82d-36667cbf2f7a","Type":"ContainerStarted","Data":"3062c491b2bf868d0576aaa1169ba3201448218d3542ca5de6b747060194c11c"} Jul 08 16:13:39.699096 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:39.699047 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" podStartSLOduration=1.538194108 podStartE2EDuration="2.699018701s" totalImagesPullingTime="1.160824593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:13:39.697175887 +0000 UTC m=+591.279048401" watchObservedRunningTime="2026-07-08 16:13:39.699018701 +0000 UTC m=+591.280891212" Jul 08 16:13:41.497075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.497013 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2"] Jul 08 16:13:41.500117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.500101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.502882 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.502858 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 16:13:41.512409 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.512380 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2"] Jul 08 16:13:41.538427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.538369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:41.596049 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.596251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68nl\" (UniqueName: \"kubernetes.io/projected/3ab5f095-f6a8-41ca-8675-f2b8deec555f-kube-api-access-x68nl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.596251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.596251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.596251 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.596416 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.596287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697715 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68nl\" (UniqueName: \"kubernetes.io/projected/3ab5f095-f6a8-41ca-8675-f2b8deec555f-kube-api-access-x68nl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.697872 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.698125 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.697993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.698184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.698120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.698184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.698169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.699955 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.699935 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ab5f095-f6a8-41ca-8675-f2b8deec555f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.700108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.700092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ab5f095-f6a8-41ca-8675-f2b8deec555f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.706916 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.706896 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68nl\" (UniqueName: \"kubernetes.io/projected/3ab5f095-f6a8-41ca-8675-f2b8deec555f-kube-api-access-x68nl\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s6xp2\" (UID: \"3ab5f095-f6a8-41ca-8675-f2b8deec555f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.812085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.811977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:41.945174 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:41.945148 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2"] Jul 08 16:13:41.946790 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:13:41.946754 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab5f095_f6a8_41ca_8675_f2b8deec555f.slice/crio-dddc3c022343bb345f26d835787e186b045d13eb865e79c8559b0fc28cbc5636 WatchSource:0}: Error finding container dddc3c022343bb345f26d835787e186b045d13eb865e79c8559b0fc28cbc5636: Status 404 returned error can't find the container with id dddc3c022343bb345f26d835787e186b045d13eb865e79c8559b0fc28cbc5636 Jul 08 16:13:42.697052 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:42.697006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" event={"ID":"3ab5f095-f6a8-41ca-8675-f2b8deec555f","Type":"ContainerStarted","Data":"8ac2cc5e3126787827115cd26e6dc37d1cbea67db838da65a402caa01439be3d"} Jul 08 16:13:42.697555 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:42.697069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" event={"ID":"3ab5f095-f6a8-41ca-8675-f2b8deec555f","Type":"ContainerStarted","Data":"dddc3c022343bb345f26d835787e186b045d13eb865e79c8559b0fc28cbc5636"} Jul 08 16:13:47.517305 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:47.517263 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:47.517773 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:47.517357 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:47.529802 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:47.529779 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:47.550679 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:47.550621 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" podStartSLOduration=6.310983262 podStartE2EDuration="6.550605622s" totalImagesPullingTime="239.62236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:13:42.725770289 +0000 UTC m=+594.307642800" watchObservedRunningTime="2026-07-08 16:13:47.550605622 +0000 UTC m=+599.132478174" Jul 08 16:13:47.747756 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:47.747729 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-rfg4n" Jul 08 16:13:50.355101 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:50.355072 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:13:50.355813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:50.355796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:13:51.534774 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:51.534720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:51.812757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:51.812660 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:51.812757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:51.812730 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:51.825337 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:51.825304 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:52.775579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:52.775546 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s6xp2" Jul 08 16:13:55.491717 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.491682 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925"] Jul 08 16:13:55.496355 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.496327 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.499301 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.499276 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 16:13:55.505551 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.505521 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925"] Jul 08 16:13:55.523776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.523737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:13:55.526952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.526895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.527108 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.526989 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.527193 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.527112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9bv\" (UniqueName: \"kubernetes.io/projected/6f574b1b-6f0f-4862-b50d-d4fb7860c033-kube-api-access-2t9bv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.527282 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.527219 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.527346 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.527285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.527417 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.527342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628300 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628359 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9bv\" (UniqueName: \"kubernetes.io/projected/6f574b1b-6f0f-4862-b50d-d4fb7860c033-kube-api-access-2t9bv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.628929 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.628847 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.630702 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.630676 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f574b1b-6f0f-4862-b50d-d4fb7860c033-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.630903 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.630886 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f574b1b-6f0f-4862-b50d-d4fb7860c033-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.636708 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.636673 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9bv\" (UniqueName: \"kubernetes.io/projected/6f574b1b-6f0f-4862-b50d-d4fb7860c033-kube-api-access-2t9bv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c6925\" (UID: \"6f574b1b-6f0f-4862-b50d-d4fb7860c033\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.808898 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.808807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:13:55.946878 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:55.946843 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925"] Jul 08 16:13:55.948049 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:13:55.948013 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f574b1b_6f0f_4862_b50d_d4fb7860c033.slice/crio-9770e2769fb5242cdae3d1b35e30c298b8b392d26cabda7aa63a7ff29e924b9a WatchSource:0}: Error finding container 9770e2769fb5242cdae3d1b35e30c298b8b392d26cabda7aa63a7ff29e924b9a: Status 404 returned error can't find the container with id 9770e2769fb5242cdae3d1b35e30c298b8b392d26cabda7aa63a7ff29e924b9a Jul 08 16:13:56.788458 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:56.788417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" event={"ID":"6f574b1b-6f0f-4862-b50d-d4fb7860c033","Type":"ContainerStarted","Data":"8b86b4ec9c957e3e7fc19b558116e8b68eda24afcd3935b1fa647148943769f3"} Jul 08 16:13:56.788852 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:56.788481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" event={"ID":"6f574b1b-6f0f-4862-b50d-d4fb7860c033","Type":"ContainerStarted","Data":"9770e2769fb5242cdae3d1b35e30c298b8b392d26cabda7aa63a7ff29e924b9a"} Jul 08 16:13:56.809207 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:56.809153 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" podStartSLOduration=1.540170586 podStartE2EDuration="1.809137614s" totalImagesPullingTime="268.967028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:13:56.807186905 +0000 UTC m=+608.389059417" watchObservedRunningTime="2026-07-08 16:13:56.809137614 +0000 UTC m=+608.391010178" Jul 08 16:13:57.879742 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:13:57.879705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:14:03.918094 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:03.918054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:14:05.809698 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:05.809663 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:14:05.810111 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:05.809726 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:14:05.822136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:05.822106 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:14:05.857920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:05.857892 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c6925" Jul 08 16:14:53.021075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:14:53.021013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:15:14.027769 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.027721 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-564ccb5cbc-cd2zh"] Jul 08 16:15:14.031541 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.031513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.040222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.040190 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564ccb5cbc-cd2zh"] Jul 08 16:15:14.085506 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.085463 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68be754e-feac-44f7-bd23-7889b30d635a-tls-cert\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.085685 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.085585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhfdn\" (UniqueName: \"kubernetes.io/projected/68be754e-feac-44f7-bd23-7889b30d635a-kube-api-access-fhfdn\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.186857 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.186818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68be754e-feac-44f7-bd23-7889b30d635a-tls-cert\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.187074 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.186885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhfdn\" (UniqueName: \"kubernetes.io/projected/68be754e-feac-44f7-bd23-7889b30d635a-kube-api-access-fhfdn\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.189386 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.189362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68be754e-feac-44f7-bd23-7889b30d635a-tls-cert\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.195665 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.195641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhfdn\" (UniqueName: \"kubernetes.io/projected/68be754e-feac-44f7-bd23-7889b30d635a-kube-api-access-fhfdn\") pod \"authorino-564ccb5cbc-cd2zh\" (UID: \"68be754e-feac-44f7-bd23-7889b30d635a\") " pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.327910 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.327799 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:15:14.342542 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.342499 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" Jul 08 16:15:14.413775 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.413689 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:15:14.490393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.490362 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564ccb5cbc-cd2zh"] Jul 08 16:15:14.491398 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:15:14.491375 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68be754e_feac_44f7_bd23_7889b30d635a.slice/crio-0e2ec32717a5379a0f7cfb01b82096acb6519272a9244787ca656cff41ef738c WatchSource:0}: Error finding container 0e2ec32717a5379a0f7cfb01b82096acb6519272a9244787ca656cff41ef738c: Status 404 returned error can't find the container with id 0e2ec32717a5379a0f7cfb01b82096acb6519272a9244787ca656cff41ef738c Jul 08 16:15:14.492804 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:14.492788 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:15:15.257839 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:15.257800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" event={"ID":"68be754e-feac-44f7-bd23-7889b30d635a","Type":"ContainerStarted","Data":"0e2ec32717a5379a0f7cfb01b82096acb6519272a9244787ca656cff41ef738c"} Jul 08 16:15:15.545223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:15.545136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:15:15.652020 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:15.651932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:15:16.270572 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.270500 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" event={"ID":"68be754e-feac-44f7-bd23-7889b30d635a","Type":"ContainerStarted","Data":"a96fd0c6aa45daacd7851c7c9077150ca5fb6ddde16361e1228b2efdefd482df"} Jul 08 16:15:16.303637 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.303568 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-564ccb5cbc-cd2zh" podStartSLOduration=1.4581709250000001 podStartE2EDuration="2.303546139s" totalImagesPullingTime="845.375214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:15:16.288846306 +0000 UTC m=+687.870718840" watchObservedRunningTime="2026-07-08 16:15:16.303546139 +0000 UTC m=+687.885418652" Jul 08 16:15:16.338795 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.338754 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:15:16.339820 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.339787 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-674fc487f4-hxpx6" podUID="7572f68e-8e05-4e8f-a944-a49f056f481b" containerName="authorino" containerID="cri-o://2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a" gracePeriod=30 Jul 08 16:15:16.599015 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.598987 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:15:16.609762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.609727 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf4m7\" (UniqueName: \"kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7\") pod \"7572f68e-8e05-4e8f-a944-a49f056f481b\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " Jul 08 16:15:16.609932 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.609792 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert\") pod \"7572f68e-8e05-4e8f-a944-a49f056f481b\" (UID: \"7572f68e-8e05-4e8f-a944-a49f056f481b\") " Jul 08 16:15:16.611877 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.611843 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7" (OuterVolumeSpecName: "kube-api-access-qf4m7") pod "7572f68e-8e05-4e8f-a944-a49f056f481b" (UID: "7572f68e-8e05-4e8f-a944-a49f056f481b"). InnerVolumeSpecName "kube-api-access-qf4m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:15:16.625284 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.625251 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7572f68e-8e05-4e8f-a944-a49f056f481b" (UID: "7572f68e-8e05-4e8f-a944-a49f056f481b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:15:16.718057 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.711025 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf4m7\" (UniqueName: \"kubernetes.io/projected/7572f68e-8e05-4e8f-a944-a49f056f481b-kube-api-access-qf4m7\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:15:16.718057 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:16.711084 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7572f68e-8e05-4e8f-a944-a49f056f481b-tls-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:15:17.279323 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.279288 2572 generic.go:356] "Generic (PLEG): container finished" podID="7572f68e-8e05-4e8f-a944-a49f056f481b" containerID="2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a" exitCode=0 Jul 08 16:15:17.279762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.279331 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674fc487f4-hxpx6" Jul 08 16:15:17.279762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.279380 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674fc487f4-hxpx6" event={"ID":"7572f68e-8e05-4e8f-a944-a49f056f481b","Type":"ContainerDied","Data":"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a"} Jul 08 16:15:17.279762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.279424 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674fc487f4-hxpx6" event={"ID":"7572f68e-8e05-4e8f-a944-a49f056f481b","Type":"ContainerDied","Data":"e22a86b9b63ad60f36ff332b9dc5956448a7993e430a92b87e96855ae2a6ccd9"} Jul 08 16:15:17.279762 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.279451 2572 scope.go:117] "RemoveContainer" containerID="2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a" Jul 08 16:15:17.289319 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.289294 2572 scope.go:117] "RemoveContainer" containerID="2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a" Jul 08 16:15:17.289629 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:15:17.289611 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a\": container with ID starting with 2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a not found: ID does not exist" containerID="2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a" Jul 08 16:15:17.289704 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.289637 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a"} err="failed to get container status \"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a\": rpc error: code = NotFound desc = could not find container \"2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a\": container with ID starting with 2714c098daea10da992eff357e3a68f9635dcb5e9ea855e75d12d657736a638a not found: ID does not exist" Jul 08 16:15:17.301788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.301760 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:15:17.305393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:17.305370 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674fc487f4-hxpx6"] Jul 08 16:15:18.471524 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:18.471490 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7572f68e-8e05-4e8f-a944-a49f056f481b" path="/var/lib/kubelet/pods/7572f68e-8e05-4e8f-a944-a49f056f481b/volumes" Jul 08 16:15:19.771479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:15:19.771441 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:16:23.047381 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:23.047344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:16:26.875492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:26.875459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:16:26.977274 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:26.977235 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:16:26.977468 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:26.977435 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-d884f6456-spn29" podUID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" containerName="manager" containerID="cri-o://a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f" gracePeriod=30 Jul 08 16:16:27.227614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.227590 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:16:27.394997 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.394962 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wkxm\" (UniqueName: \"kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm\") pod \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " Jul 08 16:16:27.395257 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.395189 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert\") pod \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\" (UID: \"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39\") " Jul 08 16:16:27.397250 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.397194 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm" (OuterVolumeSpecName: "kube-api-access-8wkxm") pod "638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" (UID: "638bbc4b-9eef-429b-bf2f-ed29b8cd6e39"). InnerVolumeSpecName "kube-api-access-8wkxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:16:27.397250 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.397216 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" (UID: "638bbc4b-9eef-429b-bf2f-ed29b8cd6e39"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:16:27.496772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.496736 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wkxm\" (UniqueName: \"kubernetes.io/projected/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-kube-api-access-8wkxm\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:16:27.496772 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.496769 2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39-webhook-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:16:27.690932 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.690897 2572 generic.go:356] "Generic (PLEG): container finished" podID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" containerID="a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f" exitCode=0 Jul 08 16:16:27.691191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.690956 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-spn29" Jul 08 16:16:27.691191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.690962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-spn29" event={"ID":"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39","Type":"ContainerDied","Data":"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f"} Jul 08 16:16:27.691191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.691081 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-spn29" event={"ID":"638bbc4b-9eef-429b-bf2f-ed29b8cd6e39","Type":"ContainerDied","Data":"4a7e40e5abd8f9962956af5b5de1d65abea423553327ffe24bddf3f68186e621"} Jul 08 16:16:27.691191 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.691103 2572 scope.go:117] "RemoveContainer" containerID="a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f" Jul 08 16:16:27.700961 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.700943 2572 scope.go:117] "RemoveContainer" containerID="a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f" Jul 08 16:16:27.701272 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:16:27.701251 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f\": container with ID starting with a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f not found: ID does not exist" containerID="a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f" Jul 08 16:16:27.701350 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.701282 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f"} err="failed to get container status \"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f\": rpc error: code = NotFound desc = could not find container \"a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f\": container with ID starting with a8756b105752b8db5489466cd2196d8c6f83ecf8aee5b6db355f1a047916de2f not found: ID does not exist" Jul 08 16:16:27.713356 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.713332 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:16:27.716812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:27.716790 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d884f6456-spn29"] Jul 08 16:16:28.416749 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.416718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:16:28.472455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.472419 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" path="/var/lib/kubelet/pods/638bbc4b-9eef-429b-bf2f-ed29b8cd6e39/volumes" Jul 08 16:16:28.526006 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.525969 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d884f6456-ff2h5"] Jul 08 16:16:28.526455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526439 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" containerName="manager" Jul 08 16:16:28.526518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526457 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" containerName="manager" Jul 08 16:16:28.526518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526469 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7572f68e-8e05-4e8f-a944-a49f056f481b" containerName="authorino" Jul 08 16:16:28.526518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526474 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7572f68e-8e05-4e8f-a944-a49f056f481b" containerName="authorino" Jul 08 16:16:28.526616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526541 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="638bbc4b-9eef-429b-bf2f-ed29b8cd6e39" containerName="manager" Jul 08 16:16:28.526616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.526552 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7572f68e-8e05-4e8f-a944-a49f056f481b" containerName="authorino" Jul 08 16:16:28.531063 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.531026 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.535160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.535137 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 16:16:28.535160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.535148 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 16:16:28.535368 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.535142 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9l52v\"" Jul 08 16:16:28.542147 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.542124 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d884f6456-ff2h5"] Jul 08 16:16:28.606598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.606558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftc8c\" (UniqueName: \"kubernetes.io/projected/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-kube-api-access-ftc8c\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.606598 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.606606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-webhook-cert\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.707446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.707414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftc8c\" (UniqueName: \"kubernetes.io/projected/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-kube-api-access-ftc8c\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.707637 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.707458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-webhook-cert\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.709836 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.709817 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-webhook-cert\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.717132 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.717107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftc8c\" (UniqueName: \"kubernetes.io/projected/a6d35ac4-1084-48a9-9a96-2113aceb7f9d-kube-api-access-ftc8c\") pod \"maas-controller-d884f6456-ff2h5\" (UID: \"a6d35ac4-1084-48a9-9a96-2113aceb7f9d\") " pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.843320 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.843281 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:28.982617 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:28.982593 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d884f6456-ff2h5"] Jul 08 16:16:28.985085 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:16:28.985058 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d35ac4_1084_48a9_9a96_2113aceb7f9d.slice/crio-ea01c4a748d7b0e36dd53eed8e8aef7220cc3051eb7cb7086822d83b240b0c8e WatchSource:0}: Error finding container ea01c4a748d7b0e36dd53eed8e8aef7220cc3051eb7cb7086822d83b240b0c8e: Status 404 returned error can't find the container with id ea01c4a748d7b0e36dd53eed8e8aef7220cc3051eb7cb7086822d83b240b0c8e Jul 08 16:16:29.705657 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:29.705619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-ff2h5" event={"ID":"a6d35ac4-1084-48a9-9a96-2113aceb7f9d","Type":"ContainerStarted","Data":"4d3b07335ebad8c8c450b6c66da811b57aae6fdac5e3e42dd6ba4d11752516b0"} Jul 08 16:16:29.706141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:29.705674 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:16:29.706141 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:29.705691 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d884f6456-ff2h5" event={"ID":"a6d35ac4-1084-48a9-9a96-2113aceb7f9d","Type":"ContainerStarted","Data":"ea01c4a748d7b0e36dd53eed8e8aef7220cc3051eb7cb7086822d83b240b0c8e"} Jul 08 16:16:29.726221 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:29.726173 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d884f6456-ff2h5" podStartSLOduration=1.356699661 podStartE2EDuration="1.726156042s" totalImagesPullingTime="369.456381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:16:29.723475414 +0000 UTC m=+761.305347919" watchObservedRunningTime="2026-07-08 16:16:29.726156042 +0000 UTC m=+761.308028551" Jul 08 16:16:40.716788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:16:40.716756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d884f6456-ff2h5" Jul 08 16:17:07.447493 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:07.447449 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:07.577197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:07.577162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:07.725004 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:07.724917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:13.480505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:13.480425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:13.869725 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:13.869634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:13.968675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:13.968642 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:19.717280 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:19.717241 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:17:19.806078 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:17:19.806015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:18:38.422411 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:18:38.422374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:18:38.485051 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:18:38.485011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:18:50.401393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:18:50.401322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:18:50.401393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:18:50.401318 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:20:24.540928 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:20:24.540834 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:20:37.734753 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:20:37.734718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:20:37.832948 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:20:37.832911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:21:03.731926 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:21:03.731893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:21:03.858340 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:21:03.858291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:23:09.047211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:23:09.047167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:23:50.449529 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:23:50.449499 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:23:50.452026 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:23:50.450746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:26:53.674123 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:26:53.673999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:12.254382 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:12.254297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:19.173867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:19.173805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:27.463827 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:27.463788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:32.633489 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:32.633444 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:35.692163 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:35.692126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:35.866625 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:35.866588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:36.230800 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:36.230763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:42.871346 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:42.871311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:42.996550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:42.996518 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:43.107453 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.107423 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:43.111002 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.110983 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115335 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115456 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115456 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115418 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115456 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzmv\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115575 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.115630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.115614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.123144 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.123079 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dbe3d898-openshift-default-dockercfg-86f6p\"" Jul 08 16:28:43.208439 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.208400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:43.216498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216668 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216944 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216944 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzmv\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.216944 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.217133 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.216989 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.217185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.217134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.217185 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.217157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.217449 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.217250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.218075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.218053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.218960 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.218940 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.219113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.219095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.236826 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.236796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.247225 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.247194 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzmv\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv\") pod \"e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.418127 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.418030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:43.421143 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.421111 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:43.481306 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.481260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:43.609806 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.609773 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:43.620599 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:28:43.620570 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5be7083_cdf3_47df_b9d1_faa6fbd59b1a.slice/crio-bbb34230ca8ef19e6d2f2b72bf765f7c764bc7dc87e08194ca26e2c70ae44406 WatchSource:0}: Error finding container bbb34230ca8ef19e6d2f2b72bf765f7c764bc7dc87e08194ca26e2c70ae44406: Status 404 returned error can't find the container with id bbb34230ca8ef19e6d2f2b72bf765f7c764bc7dc87e08194ca26e2c70ae44406 Jul 08 16:28:43.622588 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.622555 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:28:43.622677 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.622620 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:28:43.622677 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.622654 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:28:43.999616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.999528 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" event={"ID":"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a","Type":"ContainerStarted","Data":"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080"} Jul 08 16:28:43.999616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:43.999581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" event={"ID":"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a","Type":"ContainerStarted","Data":"bbb34230ca8ef19e6d2f2b72bf765f7c764bc7dc87e08194ca26e2c70ae44406"} Jul 08 16:28:44.028105 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.028058 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" podStartSLOduration=1.028026527 podStartE2EDuration="1.028026527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:28:44.027205714 +0000 UTC m=+1495.609078226" watchObservedRunningTime="2026-07-08 16:28:44.028026527 +0000 UTC m=+1495.609899043" Jul 08 16:28:44.341648 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.341548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:44.421652 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.421618 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:44.426587 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.426558 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:44.552462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.552425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:44.744462 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:44.744423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:45.005926 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:45.005845 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:45.006703 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:45.006681 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:45.265341 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:45.265250 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:45.397153 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:45.397119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:46.566322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:46.566292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:49.454059 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:49.453129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:49.632543 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:49.632504 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:49.632724 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:49.632701 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" podUID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" containerName="istio-proxy" containerID="cri-o://88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080" gracePeriod=30 Jul 08 16:28:49.661177 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:49.661139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:49.757628 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:49.757532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:50.116472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:50.116385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:50.493698 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:50.493595 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:28:50.507828 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:50.495951 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:28:52.900914 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:52.900876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:55.692217 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.692185 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:55.740492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740394 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740431 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740479 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kzmv\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740492 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740496 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740514 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740533 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740621 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740727 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740737 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:28:55.740823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.740753 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket\") pod \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\" (UID: \"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a\") " Jul 08 16:28:55.741197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741045 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:28:55.741197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741071 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:28:55.741197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741160 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-socket\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.741197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741178 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-workload-certs\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.741197 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741192 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istiod-ca-cert\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.741452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741244 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:28:55.741452 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.741433 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:28:55.742791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.742768 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 16:28:55.742895 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.742770 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:28:55.743111 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.743091 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:28:55.743199 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.743117 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv" (OuterVolumeSpecName: "kube-api-access-4kzmv") pod "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" (UID: "b5be7083-cdf3-47df-b9d1-faa6fbd59b1a"). InnerVolumeSpecName "kube-api-access-4kzmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:28:55.842242 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842205 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-data\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.842242 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842244 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kzmv\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-kube-api-access-4kzmv\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.842432 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842258 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-token\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.842432 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842271 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-podinfo\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.842432 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842283 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-istio-envoy\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:55.842432 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:55.842295 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a-credential-socket\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:28:56.088684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.088578 2572 generic.go:356] "Generic (PLEG): container finished" podID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" containerID="88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080" exitCode=0 Jul 08 16:28:56.088684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.088622 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" Jul 08 16:28:56.088935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.088675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" event={"ID":"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a","Type":"ContainerDied","Data":"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080"} Jul 08 16:28:56.088935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.088734 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49" event={"ID":"b5be7083-cdf3-47df-b9d1-faa6fbd59b1a","Type":"ContainerDied","Data":"bbb34230ca8ef19e6d2f2b72bf765f7c764bc7dc87e08194ca26e2c70ae44406"} Jul 08 16:28:56.088935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.088763 2572 scope.go:117] "RemoveContainer" containerID="88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080" Jul 08 16:28:56.099339 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.099322 2572 scope.go:117] "RemoveContainer" containerID="88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080" Jul 08 16:28:56.099610 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:28:56.099587 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080\": container with ID starting with 88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080 not found: ID does not exist" containerID="88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080" Jul 08 16:28:56.099659 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.099621 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080"} err="failed to get container status \"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080\": rpc error: code = NotFound desc = could not find container \"88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080\": container with ID starting with 88b7102aa886cab25f42de9634dcbcc9e6f479a2a41b2bc59ed4fad0989b3080 not found: ID does not exist" Jul 08 16:28:56.121355 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.121325 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:56.126916 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.126889 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dbe3d898-openshift-default-5db864c8b9-x8v49"] Jul 08 16:28:56.472154 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.472121 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" path="/var/lib/kubelet/pods/b5be7083-cdf3-47df-b9d1-faa6fbd59b1a/volumes" Jul 08 16:28:56.893672 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:56.893556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:57.058264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:57.058228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:57.327848 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:57.327808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:57.484491 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:57.484451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:58.436058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:58.435995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:58.574025 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:58.573990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:58.697479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:58.697380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:59.215276 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:59.215238 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:59.542228 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:59.542132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:28:59.645602 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:28:59.645557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:00.944821 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:00.944783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:03.631625 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:03.631577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:04.238427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:04.238393 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:09.938236 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:09.938188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:10.068586 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:10.068534 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:11.881164 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:11.881101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:16.081640 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:16.081603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:16.195134 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:16.195090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:16.323809 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:16.323770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:16.416103 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:16.415968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:17.479095 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:17.479054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:17.620467 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:17.620437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:17.727531 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:17.727498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:17.857283 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:17.857193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:18.251638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:18.251601 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:18.357077 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:18.357012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:20.089552 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:20.089519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:21.951498 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:21.951456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:22.089812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:22.089775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:22.195192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:22.195137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:22.346582 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:22.346497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:23.325842 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:23.325802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:28.482283 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:28.482246 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:28.576866 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:28.576835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:28.889389 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:28.889294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:28.993167 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:28.993133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:29.143397 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:29.143310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:30.517476 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:30.517444 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:36.816967 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:36.816910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:37.013714 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:37.013683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:37.230842 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:37.230801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:29:37.605867 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:29:37.605758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:03.619969 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:03.619920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:10.059459 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:10.059424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:10.160723 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:10.160683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:25.707497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:25.707453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:31.632202 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:31.632171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:31.720385 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:31.720343 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:31.874221 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:31.874186 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:32.033565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:32.033531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:42.453310 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:42.453204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:43.297641 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:43.297604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:49.724265 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:49.724227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:49.811577 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:49.811538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:49.911919 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:49.911885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:50.710843 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:50.710796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:50.807609 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:50.807562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:50.908091 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:50.908026 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:52.590371 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:52.590337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:58.366137 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:58.366100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:58.994786 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:58.994747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:59.095790 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:59.095747 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:59.666332 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:59.666295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:30:59.793067 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:30:59.793021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:05.308415 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:05.308376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:05.410235 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:05.410199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:05.542907 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:05.542874 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:05.856755 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:05.856715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:05.960739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:05.960707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:08.573859 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:08.573825 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:08.673424 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:08.673387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:08.790760 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:08.790719 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:09.202788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:09.202752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:09.299879 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:09.299848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:13.062579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:13.062546 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:13.733804 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:13.733764 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:13.827764 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:13.827728 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:14.176739 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:14.176706 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:20.442633 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:20.442591 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:20.542564 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:20.542533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:20.996222 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:20.996185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:21.878726 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:21.878688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:21.979518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:21.979483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:27.221915 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:27.221880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:27.322715 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:27.322656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:27.500825 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:27.500722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:27.869367 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:27.869275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:27.957934 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:27.957900 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:28.069267 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:28.069235 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:33.982166 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:33.982126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:34.049455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:34.049376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:34.144358 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:34.144323 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:34.252098 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:34.251994 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:34.434691 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:34.434649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:40.368001 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:40.367946 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:40.472161 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:40.472128 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:47.196885 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:47.196845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:47.517392 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:47.517284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:47.808327 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:47.808242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:49.380158 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:49.380120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:49.476098 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:49.476061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:50.547351 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:50.547315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:51.105536 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:51.105496 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:51.206725 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:51.206683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:51.304955 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:51.304917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:51.405899 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:51.405806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:31:54.996646 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:31:54.996604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:20.283113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:20.283075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:27.705791 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.705748 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:32:27.706453 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.706430 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" containerName="istio-proxy" Jul 08 16:32:27.706528 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.706455 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" containerName="istio-proxy" Jul 08 16:32:27.706604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.706585 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5be7083-cdf3-47df-b9d1-faa6fbd59b1a" containerName="istio-proxy" Jul 08 16:32:27.710078 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.710054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.714682 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.714655 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f66b739c\"/\"kube-root-ca.crt\"" Jul 08 16:32:27.714981 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.714655 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f66b739c\"/\"openshift-service-ca.crt\"" Jul 08 16:32:27.714981 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.714767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f66b739c\"/\"e2e-lifecycle-model-f66b739c-kserve-self-signed-certs\"" Jul 08 16:32:27.715212 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.715074 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f66b739c\"/\"default-dockercfg-rvl57\"" Jul 08 16:32:27.717898 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.717875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:32:27.732131 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.732089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:27.828793 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.828753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsknn\" (UniqueName: \"kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.828971 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.828862 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.828971 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.828901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.828971 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.828947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.829117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.828987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.829117 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.829018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.929963 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.929916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.929963 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.929968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsknn\" (UniqueName: \"kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930403 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.930539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.930504 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.932265 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.932246 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.932542 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.932523 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:27.939779 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:27.939746 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsknn\" (UniqueName: \"kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn\") pod \"e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:28.021750 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:28.021652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:28.162972 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:28.162939 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:32:28.164787 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:32:28.164761 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0388367_a03b_48a9_91b4_c2495a29223c.slice/crio-8798bca3d9d668715f84f25b93da3ce669529c2bf0cf6581c50659c0b12b7546 WatchSource:0}: Error finding container 8798bca3d9d668715f84f25b93da3ce669529c2bf0cf6581c50659c0b12b7546: Status 404 returned error can't find the container with id 8798bca3d9d668715f84f25b93da3ce669529c2bf0cf6581c50659c0b12b7546 Jul 08 16:32:28.304236 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:28.304153 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" event={"ID":"a0388367-a03b-48a9-91b4-c2495a29223c","Type":"ContainerStarted","Data":"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4"} Jul 08 16:32:28.304236 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:28.304194 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" event={"ID":"a0388367-a03b-48a9-91b4-c2495a29223c","Type":"ContainerStarted","Data":"8798bca3d9d668715f84f25b93da3ce669529c2bf0cf6581c50659c0b12b7546"} Jul 08 16:32:28.330485 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:28.325690 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" podStartSLOduration=1.325669842 podStartE2EDuration="1.325669842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:32:28.322264643 +0000 UTC m=+1719.904137151" watchObservedRunningTime="2026-07-08 16:32:28.325669842 +0000 UTC m=+1719.907542357" Jul 08 16:32:33.393536 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:33.393496 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:38.021902 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:38.021867 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:38.022436 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:38.022199 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:38.035534 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:38.035508 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:38.374115 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:38.374002 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:32:53.050353 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:53.050315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:53.424817 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:53.424788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:32:59.171092 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:32:59.171050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:04.152674 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:04.152639 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:33:04.244803 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:04.244769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:19.174217 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.174150 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" podUID="a0388367-a03b-48a9-91b4-c2495a29223c" containerName="main" containerID="cri-o://57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4" gracePeriod=45 Jul 08 16:33:19.425936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.425867 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:33:19.528613 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528584 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.528776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528628 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.528776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528646 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.528776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528674 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsknn\" (UniqueName: \"kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.528776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528705 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.528776 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528734 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs\") pod \"a0388367-a03b-48a9-91b4-c2495a29223c\" (UID: \"a0388367-a03b-48a9-91b4-c2495a29223c\") " Jul 08 16:33:19.529029 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528911 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home" (OuterVolumeSpecName: "home") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:33:19.529029 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528950 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:33:19.529029 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.528961 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache" (OuterVolumeSpecName: "model-cache") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:33:19.529254 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.529233 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-tmp-dir\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:19.529332 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.529258 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-home\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:19.529332 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.529271 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-model-cache\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:19.531018 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.530994 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm" (OuterVolumeSpecName: "dshm") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:33:19.531104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.531004 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:33:19.531104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.531003 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn" (OuterVolumeSpecName: "kube-api-access-gsknn") pod "a0388367-a03b-48a9-91b4-c2495a29223c" (UID: "a0388367-a03b-48a9-91b4-c2495a29223c"). InnerVolumeSpecName "kube-api-access-gsknn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:33:19.599209 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.599174 2572 generic.go:356] "Generic (PLEG): container finished" podID="a0388367-a03b-48a9-91b4-c2495a29223c" containerID="57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4" exitCode=0 Jul 08 16:33:19.599379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.599221 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" Jul 08 16:33:19.599379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.599259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" event={"ID":"a0388367-a03b-48a9-91b4-c2495a29223c","Type":"ContainerDied","Data":"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4"} Jul 08 16:33:19.599379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.599311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2" event={"ID":"a0388367-a03b-48a9-91b4-c2495a29223c","Type":"ContainerDied","Data":"8798bca3d9d668715f84f25b93da3ce669529c2bf0cf6581c50659c0b12b7546"} Jul 08 16:33:19.599379 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.599333 2572 scope.go:117] "RemoveContainer" containerID="57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4" Jul 08 16:33:19.608920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.608898 2572 scope.go:117] "RemoveContainer" containerID="57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4" Jul 08 16:33:19.609250 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:33:19.609225 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4\": container with ID starting with 57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4 not found: ID does not exist" containerID="57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4" Jul 08 16:33:19.609346 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.609255 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4"} err="failed to get container status \"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4\": rpc error: code = NotFound desc = could not find container \"57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4\": container with ID starting with 57c2ba77c0f64f9261952256183341fafcae8801247291ef33dd04b516d7c7e4 not found: ID does not exist" Jul 08 16:33:19.622400 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.622375 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:33:19.625985 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.625963 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f66b739c/e2e-lifecycle-model-f66b739c-kserve-65b75d8579-qm2w2"] Jul 08 16:33:19.630113 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.630091 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsknn\" (UniqueName: \"kubernetes.io/projected/a0388367-a03b-48a9-91b4-c2495a29223c-kube-api-access-gsknn\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:19.630203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.630115 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0388367-a03b-48a9-91b4-c2495a29223c-tls-certs\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:19.630203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:19.630125 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0388367-a03b-48a9-91b4-c2495a29223c-dshm\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:33:20.471921 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:20.471891 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0388367-a03b-48a9-91b4-c2495a29223c" path="/var/lib/kubelet/pods/a0388367-a03b-48a9-91b4-c2495a29223c/volumes" Jul 08 16:33:40.501344 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:40.501262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:41.745665 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:41.745590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:47.895680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:47.895639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:47.998583 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:47.998548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:48.198444 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:48.198410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:49.457634 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:49.457597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:49.562264 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:49.562224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:49.662539 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:49.662505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:50.416538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:50.416497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:50.514477 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:50.514448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:50.534104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:50.534073 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:33:50.537681 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:50.537657 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:33:50.617028 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:50.616993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:52.010568 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:52.010527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:57.866500 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:57.866462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:57.966845 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:57.966814 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:33:58.526536 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:33:58.526502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:04.879457 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:04.879414 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:04.993429 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:04.993387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:05.091727 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:05.091692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:15.605404 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:15.605369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:15.979578 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:15.979537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:36.972766 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:36.972727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:43.296056 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:43.292876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:43.395928 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:43.395889 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:43.640131 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:43.640028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:43.979628 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:43.979588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:44.242972 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:44.242883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:47.318752 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:47.318711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:47.419865 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:47.419830 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:47.555407 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:47.555374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:47.655813 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:47.655720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:48.201079 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:48.201028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:48.301812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:48.301780 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:51.753886 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:51.753850 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:52.127920 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:52.127810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:52.419134 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:52.419019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:52.862677 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:52.862637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:55.632058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:55.632002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:55.729812 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:55.729778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:55.825757 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:55.825717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:56.016242 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:56.016210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:56.188542 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:56.188504 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:34:56.289231 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:34:56.289144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:00.127543 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:00.127502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:10.058680 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:10.058644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:10.160255 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:10.160222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.395958 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.395921 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:35:12.396596 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.396575 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0388367-a03b-48a9-91b4-c2495a29223c" containerName="main" Jul 08 16:35:12.396684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.396599 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0388367-a03b-48a9-91b4-c2495a29223c" containerName="main" Jul 08 16:35:12.396743 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.396694 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0388367-a03b-48a9-91b4-c2495a29223c" containerName="main" Jul 08 16:35:12.399777 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.399756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.403908 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.403885 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ea60a0\"/\"kube-root-ca.crt\"" Jul 08 16:35:12.404023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.403910 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ea60a0\"/\"openshift-service-ca.crt\"" Jul 08 16:35:12.404023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.403923 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ea60a0\"/\"test-model-ea60a0-kserve-self-signed-certs\"" Jul 08 16:35:12.404023 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.403884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ea60a0\"/\"default-dockercfg-4vdlp\"" Jul 08 16:35:12.410322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.410298 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:35:12.423288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423250 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.423438 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tnc\" (UniqueName: \"kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.423438 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.423565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.423565 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.423662 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.423570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.427441 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.427417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:12.524466 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524426 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.524684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.524684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.524684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.524684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.524684 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.524586 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tnc\" (UniqueName: \"kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.525443 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.525416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.525607 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.525568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.525768 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.525649 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.533728 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.533580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.534243 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.534219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.535885 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.535858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tnc\" (UniqueName: \"kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc\") pod \"test-model-ea60a0-kserve-5865bfd979-pmjld\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.709814 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.709783 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:12.851329 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:12.851301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:35:12.853175 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:35:12.853147 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36bc8b79_2f38_4519_85e6_fdef61b6fcff.slice/crio-476eb23d4ae4621600729cd4384e10124ca3bf4379340e25a79d5fcd6a226a3a WatchSource:0}: Error finding container 476eb23d4ae4621600729cd4384e10124ca3bf4379340e25a79d5fcd6a226a3a: Status 404 returned error can't find the container with id 476eb23d4ae4621600729cd4384e10124ca3bf4379340e25a79d5fcd6a226a3a Jul 08 16:35:13.253012 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:13.252977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" event={"ID":"36bc8b79-2f38-4519-85e6-fdef61b6fcff","Type":"ContainerStarted","Data":"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3"} Jul 08 16:35:13.253230 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:13.253020 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" event={"ID":"36bc8b79-2f38-4519-85e6-fdef61b6fcff","Type":"ContainerStarted","Data":"476eb23d4ae4621600729cd4384e10124ca3bf4379340e25a79d5fcd6a226a3a"} Jul 08 16:35:13.274486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:13.274441 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" podStartSLOduration=1.2744253460000001 podStartE2EDuration="1.274425346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:13.273591644 +0000 UTC m=+1884.855464154" watchObservedRunningTime="2026-07-08 16:35:13.274425346 +0000 UTC m=+1884.856297855" Jul 08 16:35:18.076136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:18.076098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:18.176313 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:18.176275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:35:22.710145 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:22.710108 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:22.710546 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:22.710160 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:22.722615 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:22.722589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:23.323478 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:23.323442 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:35:37.650700 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:35:37.650668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:21.973121 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:21.973083 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:36:22.016866 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:22.016829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.054421 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.054390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.238822 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.238791 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.634499 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.634463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.734102 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.734067 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.833579 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.833546 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:23.936189 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:23.936153 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:28.712420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:28.712377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:36.995447 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:36.995376 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" podUID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" containerName="main" containerID="cri-o://0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3" gracePeriod=45 Jul 08 16:36:37.253163 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.253088 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:36:37.330765 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330730 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.330975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330786 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.330975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330812 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.330975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330844 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84tnc\" (UniqueName: \"kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.330975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330926 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.330975 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.330952 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm\") pod \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\" (UID: \"36bc8b79-2f38-4519-85e6-fdef61b6fcff\") " Jul 08 16:36:37.331309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.331092 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:36:37.331309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.331108 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache" (OuterVolumeSpecName: "model-cache") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:36:37.331309 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.331263 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home" (OuterVolumeSpecName: "home") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:36:37.331422 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.331324 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tmp-dir\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.331422 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.331344 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-model-cache\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.333107 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.333080 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm" (OuterVolumeSpecName: "dshm") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:36:37.333223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.333122 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:37.333223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.333123 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc" (OuterVolumeSpecName: "kube-api-access-84tnc") pod "36bc8b79-2f38-4519-85e6-fdef61b6fcff" (UID: "36bc8b79-2f38-4519-85e6-fdef61b6fcff"). InnerVolumeSpecName "kube-api-access-84tnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:37.432678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.432629 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36bc8b79-2f38-4519-85e6-fdef61b6fcff-tls-certs\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.432678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.432673 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84tnc\" (UniqueName: \"kubernetes.io/projected/36bc8b79-2f38-4519-85e6-fdef61b6fcff-kube-api-access-84tnc\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.432678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.432685 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-home\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.432678 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.432693 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36bc8b79-2f38-4519-85e6-fdef61b6fcff-dshm\") on node \"ip-10-0-136-114.ec2.internal\" DevicePath \"\"" Jul 08 16:36:37.754977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.754941 2572 generic.go:356] "Generic (PLEG): container finished" podID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" containerID="0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3" exitCode=0 Jul 08 16:36:37.754977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.754982 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" Jul 08 16:36:37.755296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.755018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" event={"ID":"36bc8b79-2f38-4519-85e6-fdef61b6fcff","Type":"ContainerDied","Data":"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3"} Jul 08 16:36:37.755296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.755099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld" event={"ID":"36bc8b79-2f38-4519-85e6-fdef61b6fcff","Type":"ContainerDied","Data":"476eb23d4ae4621600729cd4384e10124ca3bf4379340e25a79d5fcd6a226a3a"} Jul 08 16:36:37.755296 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.755121 2572 scope.go:117] "RemoveContainer" containerID="0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3" Jul 08 16:36:37.764944 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.764925 2572 scope.go:117] "RemoveContainer" containerID="0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3" Jul 08 16:36:37.765234 ip-10-0-136-114 kubenswrapper[2572]: E0708 16:36:37.765215 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3\": container with ID starting with 0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3 not found: ID does not exist" containerID="0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3" Jul 08 16:36:37.765291 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.765253 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3"} err="failed to get container status \"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3\": rpc error: code = NotFound desc = could not find container \"0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3\": container with ID starting with 0d8a7b96cefc60df5e8c970bc62c708a33504fb7b42c8a20c6cda2dadeaba1b3 not found: ID does not exist" Jul 08 16:36:37.778555 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.778526 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:36:37.782094 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:37.782070 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ea60a0/test-model-ea60a0-kserve-5865bfd979-pmjld"] Jul 08 16:36:38.472303 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:38.472270 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" path="/var/lib/kubelet/pods/36bc8b79-2f38-4519-85e6-fdef61b6fcff/volumes" Jul 08 16:36:50.217359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:50.217264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:36:50.317421 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:36:50.317383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:05.791334 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:05.791300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:06.078374 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:06.078282 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:06.483168 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:06.483117 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:06.948211 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:06.948168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:07.075060 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:07.075000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:07.179892 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:07.179862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:07.379935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:07.379832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:13.161620 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:13.161576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:13.262824 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:13.262785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:13.439085 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:13.439049 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:14.019260 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:14.019223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:14.338616 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:14.338517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:14.404704 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:14.404666 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:16.892466 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:16.892426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:16.985261 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:16.985228 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:17.082705 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:17.082665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:17.312435 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:17.312401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:17.687081 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:17.687016 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:17.788464 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:17.788430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:21.382518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:21.382474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:21.852852 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:21.852817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:24.157238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:24.157200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:25.408976 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:25.408935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:25.507521 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:25.507491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:25.814207 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:25.814171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:25.916132 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:25.916093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:26.072343 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:26.072257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:26.167134 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:26.167087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:29.905013 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:29.904977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:38.095990 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:38.095953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:38.434550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:38.434512 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:38.557790 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:38.557749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:38.763724 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:38.763633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:38.963422 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:38.963389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:44.945114 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:44.945073 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.045387 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:45.045353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.164852 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:45.164818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.541630 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:45.541588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:45.933339 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:45.933301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:46.095288 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:46.095253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:46.195882 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:46.195785 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:46.379831 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:46.379789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:52.156497 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:52.156460 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:52.305850 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:52.305812 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:52.473208 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:52.473174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:52.985395 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:52.985358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:53.303030 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:53.302943 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:53.474469 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:53.474438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:56.061483 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:56.061443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:56.157628 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:56.157597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:56.980854 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:56.980821 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:37:57.081525 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:37:57.081483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:00.760104 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:00.760072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:00.892725 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:00.892691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:01.226446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:01.226408 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:01.631783 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:01.631683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:04.647604 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:04.647559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:04.801864 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:04.801822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:04.922102 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:04.922065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:05.359645 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:05.359557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:05.460505 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:05.460469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:05.560443 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:05.560406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:09.132080 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:09.132014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:17.660285 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:17.660249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:17.759551 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:17.759514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:22.610223 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:22.610186 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:22.712208 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:22.712171 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:26.173770 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:26.173732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:26.275594 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:26.275555 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:38:50.577083 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:50.577055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:38:50.582637 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:38:50.582613 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26bt2_f543f4a7-9a15-47dd-9a96-b175d023857d/ovn-acl-logging/0.log" Jul 08 16:39:11.599793 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:39:11.599755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.094322 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:14.094235 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.450782 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:14.450750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.582614 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:14.582580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.685935 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:14.685904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:14.835318 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:14.835172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:20.660994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:20.660949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:20.762206 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:20.762164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:20.917800 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:20.917706 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:21.281463 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:21.281429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:21.677279 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:21.677247 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:21.781570 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:21.781535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:21.878391 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:21.878355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:21.973503 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:21.973418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:27.620059 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:27.620000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:27.691140 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:27.691105 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:27.898735 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:27.898647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:28.711793 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:28.711762 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564ccb5cbc-cd2zh_68be754e-feac-44f7-bd23-7889b30d635a/authorino/0.log" Jul 08 16:41:33.479325 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:33.479297 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mvk7t_b737ed2d-8478-4c3b-be80-a1e116da26a0/manager/0.log" Jul 08 16:41:33.599819 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:33.599787 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9b7qp_3f72c389-d719-4210-bda7-48546c426b20/manager/0.log" Jul 08 16:41:33.744967 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:33.744886 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d884f6456-ff2h5_a6d35ac4-1084-48a9-9a96-2113aceb7f9d/manager/0.log" Jul 08 16:41:33.864176 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:33.864151 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lw85p_50398117-5339-4dec-bb94-97f207e7059d/server/0.log" Jul 08 16:41:34.270408 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:34.270380 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-bkdnv_a61a7be9-8de2-45ac-989a-c9c9ba32cfb3/copy-manifests/0.log" Jul 08 16:41:34.279110 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:34.279087 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-bkdnv_a61a7be9-8de2-45ac-989a-c9c9ba32cfb3/manager/0.log" Jul 08 16:41:35.273247 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.273221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/util/0.log" Jul 08 16:41:35.282393 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.282357 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/pull/0.log" Jul 08 16:41:35.290256 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.290223 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/extract/0.log" Jul 08 16:41:35.411912 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.411879 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/util/0.log" Jul 08 16:41:35.421424 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.421400 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/pull/0.log" Jul 08 16:41:35.435238 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.435211 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/extract/0.log" Jul 08 16:41:35.571737 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.571645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/util/0.log" Jul 08 16:41:35.579482 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.579454 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/pull/0.log" Jul 08 16:41:35.587008 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.586974 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/extract/0.log" Jul 08 16:41:35.712618 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.712587 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/util/0.log" Jul 08 16:41:35.719249 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.719218 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/pull/0.log" Jul 08 16:41:35.725190 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.725167 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/extract/0.log" Jul 08 16:41:35.863631 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.863542 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564ccb5cbc-cd2zh_68be754e-feac-44f7-bd23-7889b30d635a/authorino/0.log" Jul 08 16:41:35.982532 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:35.982496 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7msqs_4be380d6-c39c-4fd4-9c39-a4daa112df29/manager/0.log" Jul 08 16:41:36.221431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:36.221402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wnkn6_a019548b-3bdf-4d2c-88e0-4a237b753817/kuadrant-console-plugin/0.log" Jul 08 16:41:36.345213 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:36.345177 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tss9g_9cb1a665-c0f0-455a-9dc6-8f409e1183ee/registry-server/0.log" Jul 08 16:41:36.707986 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:36.707958 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dwlcs_cd2ba086-382f-4a7d-98a8-42aa301cbe36/manager/0.log" Jul 08 16:41:37.058532 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:37.058442 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q6nk6_6d8c70df-7396-4b64-a170-03c687246582/istio-proxy/0.log" Jul 08 16:41:37.412233 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:37.412144 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-n62rt_7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7/kube-auth-proxy/0.log" Jul 08 16:41:37.537648 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:37.537614 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/1.log" Jul 08 16:41:37.784287 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:37.784259 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t5fhm_74e34c38-70d4-4242-9db2-f88eff45adb7/payload-processing/0.log" Jul 08 16:41:38.384805 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:38.384776 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-rfg4n_360e621b-4123-4d31-a82d-36667cbf2f7a/main/0.log" Jul 08 16:41:38.502632 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:38.502598 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-s6xp2_3ab5f095-f6a8-41ca-8675-f2b8deec555f/main/0.log" Jul 08 16:41:38.737623 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:38.737591 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-c6925_6f574b1b-6f0f-4862-b50d-d4fb7860c033/main/0.log" Jul 08 16:41:43.262970 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.262930 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvbgl/must-gather-2784k"] Jul 08 16:41:43.263438 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.263423 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" containerName="main" Jul 08 16:41:43.263483 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.263439 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" containerName="main" Jul 08 16:41:43.263518 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.263514 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bc8b79-2f38-4519-85e6-fdef61b6fcff" containerName="main" Jul 08 16:41:43.266797 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.266777 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.270385 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.270354 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qvbgl\"/\"default-dockercfg-2sphb\"" Jul 08 16:41:43.271455 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.271435 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvbgl\"/\"openshift-service-ca.crt\"" Jul 08 16:41:43.271594 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.271473 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvbgl\"/\"kube-root-ca.crt\"" Jul 08 16:41:43.278675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.278645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-must-gather-output\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.278801 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.278771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rcn\" (UniqueName: \"kubernetes.io/projected/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-kube-api-access-c2rcn\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.287736 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.287701 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/must-gather-2784k"] Jul 08 16:41:43.379926 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.379893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-must-gather-output\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.380169 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.380004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rcn\" (UniqueName: \"kubernetes.io/projected/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-kube-api-access-c2rcn\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.380321 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.380299 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-must-gather-output\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.389636 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.389607 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rcn\" (UniqueName: \"kubernetes.io/projected/a296aa0c-7cfb-4925-a96d-fedc5fa99d57-kube-api-access-c2rcn\") pod \"must-gather-2784k\" (UID: \"a296aa0c-7cfb-4925-a96d-fedc5fa99d57\") " pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.576473 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.576374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/must-gather-2784k" Jul 08 16:41:43.719817 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.719786 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/must-gather-2784k"] Jul 08 16:41:43.720678 ip-10-0-136-114 kubenswrapper[2572]: W0708 16:41:43.720649 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda296aa0c_7cfb_4925_a96d_fedc5fa99d57.slice/crio-0b893ce397b7b8b8490ff278e2ff0dde363f069fcc7cd2b4607bb5fdb37dbd47 WatchSource:0}: Error finding container 0b893ce397b7b8b8490ff278e2ff0dde363f069fcc7cd2b4607bb5fdb37dbd47: Status 404 returned error can't find the container with id 0b893ce397b7b8b8490ff278e2ff0dde363f069fcc7cd2b4607bb5fdb37dbd47 Jul 08 16:41:43.722540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:43.722521 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:41:44.548380 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:44.548341 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/must-gather-2784k" event={"ID":"a296aa0c-7cfb-4925-a96d-fedc5fa99d57","Type":"ContainerStarted","Data":"0b893ce397b7b8b8490ff278e2ff0dde363f069fcc7cd2b4607bb5fdb37dbd47"} Jul 08 16:41:45.290359 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:45.290313 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:45.349173 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:45.349120 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:45.559086 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:45.558977 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/must-gather-2784k" event={"ID":"a296aa0c-7cfb-4925-a96d-fedc5fa99d57","Type":"ContainerStarted","Data":"6a658ac98ba3e9d9a0e69efe28105c97d42de250aaec608c435ed4139b599b93"} Jul 08 16:41:45.559086 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:45.559023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/must-gather-2784k" event={"ID":"a296aa0c-7cfb-4925-a96d-fedc5fa99d57","Type":"ContainerStarted","Data":"d85c8b87b4646f0954becfdd6e40b7d343ecffe1d135aabc6ef788ba54989cbd"} Jul 08 16:41:45.575638 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:45.575584 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvbgl/must-gather-2784k" podStartSLOduration=1.7272914080000001 podStartE2EDuration="2.575562151s" totalImagesPullingTime="848.270743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:45.575306763 +0000 UTC m=+2277.157179298" watchObservedRunningTime="2026-07-08 16:41:45.575562151 +0000 UTC m=+2277.157434662" Jul 08 16:41:46.204486 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:46.204452 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wtqbv_74a247e1-67ea-48e8-a307-77250c689099/global-pull-secret-syncer/0.log" Jul 08 16:41:46.303940 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:46.303904 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" Jul 08 16:41:46.389160 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:46.389130 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-114.ec2.internal_86a3528a3f56534f647f2afc26d1f80b/haproxy/0.log" Jul 08 16:41:51.108954 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.099978 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/extract/0.log" Jul 08 16:41:51.135075 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.131865 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/util/0.log" Jul 08 16:41:51.157418 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.157381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qp2b2_7dad3561-81fd-4693-a85c-590f28857d01/pull/0.log" Jul 08 16:41:51.188741 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.188716 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/extract/0.log" Jul 08 16:41:51.219059 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.218841 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/util/0.log" Jul 08 16:41:51.260892 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.260832 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058qd2_4174d89e-37c8-4c15-874d-1a71ab47aac8/pull/0.log" Jul 08 16:41:51.262958 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.262933 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:51.293248 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.293221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/extract/0.log" Jul 08 16:41:51.326721 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.326697 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/util/0.log" Jul 08 16:41:51.361210 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.361130 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fqq4w_0fd71df4-8e5a-4124-85a9-cf0066a09d4a/pull/0.log" Jul 08 16:41:51.361860 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.361831 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:41:51.411753 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.411725 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/extract/0.log" Jul 08 16:41:51.443471 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.443436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/util/0.log" Jul 08 16:41:51.478707 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.478588 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15xsnc_9ecd07c1-a288-4a65-8252-50875101eb0e/pull/0.log" Jul 08 16:41:51.880058 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.879989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564ccb5cbc-cd2zh_68be754e-feac-44f7-bd23-7889b30d635a/authorino/0.log" Jul 08 16:41:51.920859 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.920827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7msqs_4be380d6-c39c-4fd4-9c39-a4daa112df29/manager/0.log" Jul 08 16:41:51.999915 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:51.999874 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wnkn6_a019548b-3bdf-4d2c-88e0-4a237b753817/kuadrant-console-plugin/0.log" Jul 08 16:41:52.055136 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:52.054920 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tss9g_9cb1a665-c0f0-455a-9dc6-8f409e1183ee/registry-server/0.log" Jul 08 16:41:52.318711 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:52.318672 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dwlcs_cd2ba086-382f-4a7d-98a8-42aa301cbe36/manager/0.log" Jul 08 16:41:53.919000 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:53.918915 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/alertmanager/0.log" Jul 08 16:41:53.943589 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:53.943564 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/config-reloader/0.log" Jul 08 16:41:53.970523 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:53.970454 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/kube-rbac-proxy-web/0.log" Jul 08 16:41:53.995213 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:53.994890 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/kube-rbac-proxy/0.log" Jul 08 16:41:54.020427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.020392 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/kube-rbac-proxy-metric/0.log" Jul 08 16:41:54.044810 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.044784 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/prom-label-proxy/0.log" Jul 08 16:41:54.068717 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.068691 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb8e3674-3125-4f8a-a421-fa41601fc6fd/init-config-reloader/0.log" Jul 08 16:41:54.138446 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.138417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mwtmd_1351d239-5c97-4958-b286-13aba2e84c63/kube-state-metrics/0.log" Jul 08 16:41:54.161081 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.161030 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mwtmd_1351d239-5c97-4958-b286-13aba2e84c63/kube-rbac-proxy-main/0.log" Jul 08 16:41:54.184563 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.184513 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mwtmd_1351d239-5c97-4958-b286-13aba2e84c63/kube-rbac-proxy-self/0.log" Jul 08 16:41:54.293959 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.293907 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82zqb_842674c5-bf9e-47b6-afe0-e018786f2459/node-exporter/0.log" Jul 08 16:41:54.314977 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.314945 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82zqb_842674c5-bf9e-47b6-afe0-e018786f2459/kube-rbac-proxy/0.log" Jul 08 16:41:54.336534 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.336502 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-82zqb_842674c5-bf9e-47b6-afe0-e018786f2459/init-textfile/0.log" Jul 08 16:41:54.535347 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.535266 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ndfdd_fccc5739-6882-4990-a121-417ba8732073/kube-rbac-proxy-main/0.log" Jul 08 16:41:54.558151 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.558123 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ndfdd_fccc5739-6882-4990-a121-417ba8732073/kube-rbac-proxy-self/0.log" Jul 08 16:41:54.579467 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.579436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-ndfdd_fccc5739-6882-4990-a121-417ba8732073/openshift-state-metrics/0.log" Jul 08 16:41:54.805178 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.805088 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xqz2p_a8e6c73b-0f70-412d-99dc-aff4c73935d6/prometheus-operator/0.log" Jul 08 16:41:54.823974 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.823945 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xqz2p_a8e6c73b-0f70-412d-99dc-aff4c73935d6/kube-rbac-proxy/0.log" Jul 08 16:41:54.848675 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.848635 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-c6q8w_95e6b389-b312-46dc-b5f3-3b78f30c9f9f/prometheus-operator-admission-webhook/0.log" Jul 08 16:41:54.891749 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.891719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb6b7b48b-7x6b4_b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409/telemeter-client/0.log" Jul 08 16:41:54.912433 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.912402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb6b7b48b-7x6b4_b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409/reload/0.log" Jul 08 16:41:54.934721 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:54.934691 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb6b7b48b-7x6b4_b0c7e8e3-5ffe-45a1-8dc6-7eb78ca9c409/kube-rbac-proxy/0.log" Jul 08 16:41:56.600853 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.600794 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx"] Jul 08 16:41:56.607112 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.607079 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.613788 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.613753 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx"] Jul 08 16:41:56.745281 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.745240 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-podres\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.745479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.745307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9hc\" (UniqueName: \"kubernetes.io/projected/c3beabcd-fd92-48ba-89d0-8b8861111e33-kube-api-access-cq9hc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.745479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.745347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-sys\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.745479 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.745385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-lib-modules\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.745671 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.745488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-proc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847226 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-proc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-podres\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9hc\" (UniqueName: \"kubernetes.io/projected/c3beabcd-fd92-48ba-89d0-8b8861111e33-kube-api-access-cq9hc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-sys\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847420 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-lib-modules\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847622 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847581 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-lib-modules\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847683 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-proc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.847740 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.847724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-podres\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.848184 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.848154 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3beabcd-fd92-48ba-89d0-8b8861111e33-sys\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.857751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.857677 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9hc\" (UniqueName: \"kubernetes.io/projected/c3beabcd-fd92-48ba-89d0-8b8861111e33-kube-api-access-cq9hc\") pod \"perf-node-gather-daemonset-pq4mx\" (UID: \"c3beabcd-fd92-48ba-89d0-8b8861111e33\") " pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:56.921201 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:56.921159 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:57.116192 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.116108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx"] Jul 08 16:41:57.483703 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.483679 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cf978ffb7-5gb8w_4befccda-c6ea-415e-926e-9d82767359f9/console/0.log" Jul 08 16:41:57.668823 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.668779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" event={"ID":"c3beabcd-fd92-48ba-89d0-8b8861111e33","Type":"ContainerStarted","Data":"930f78ac2903213a4544aa1e6e9d03e7183f3879fe9c9271331e474fe363ab5f"} Jul 08 16:41:57.669298 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.668837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" event={"ID":"c3beabcd-fd92-48ba-89d0-8b8861111e33","Type":"ContainerStarted","Data":"4f46d16da4d72c63f1db4a064849bb3c90e377b8451077763aec508bd63c9016"} Jul 08 16:41:57.669298 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.668867 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:41:57.689239 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:57.689190 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" podStartSLOduration=1.6891749059999999 podStartE2EDuration="1.689174906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:57.686443621 +0000 UTC m=+2289.268316134" watchObservedRunningTime="2026-07-08 16:41:57.689174906 +0000 UTC m=+2289.271047417" Jul 08 16:41:59.229533 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:59.229504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wwrrt_93cffcd9-ca81-425f-ab92-e33ca7b7250b/dns/0.log" Jul 08 16:41:59.249741 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:59.249690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wwrrt_93cffcd9-ca81-425f-ab92-e33ca7b7250b/kube-rbac-proxy/0.log" Jul 08 16:41:59.348496 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:59.348470 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vbnm_7205266f-f9b5-427e-ac93-5545dc478fa7/dns-node-resolver/0.log" Jul 08 16:41:59.959496 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:41:59.959453 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvtw4_1b3dea69-0b99-490d-a1cd-e70276215f9e/node-ca/0.log" Jul 08 16:42:00.899230 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:00.899200 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q6nk6_6d8c70df-7396-4b64-a170-03c687246582/istio-proxy/0.log" Jul 08 16:42:01.048988 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:01.048947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-n62rt_7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7/kube-auth-proxy/0.log" Jul 08 16:42:01.081551 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:01.081480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/0.log" Jul 08 16:42:01.146183 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:01.146149 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/1.log" Jul 08 16:42:01.266381 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:01.266347 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t5fhm_74e34c38-70d4-4242-9db2-f88eff45adb7/payload-processing/0.log" Jul 08 16:42:02.033946 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:02.033915 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xrs2h_2ef20300-0f27-48c0-b335-39fe6346461e/serve-healthcheck-canary/0.log" Jul 08 16:42:02.614203 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:02.614172 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4v84_56237a07-3740-4e3f-86b3-79cc00a4ac2e/kube-rbac-proxy/0.log" Jul 08 16:42:02.635751 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:02.635715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4v84_56237a07-3740-4e3f-86b3-79cc00a4ac2e/exporter/0.log" Jul 08 16:42:02.657538 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:02.657503 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m4v84_56237a07-3740-4e3f-86b3-79cc00a4ac2e/extractor/0.log" Jul 08 16:42:03.695541 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:03.694518 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qvbgl/perf-node-gather-daemonset-pq4mx" Jul 08 16:42:04.939644 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:04.939608 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mvk7t_b737ed2d-8478-4c3b-be80-a1e116da26a0/manager/0.log" Jul 08 16:42:05.156994 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:05.156949 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9b7qp_3f72c389-d719-4210-bda7-48546c426b20/manager/0.log" Jul 08 16:42:05.306647 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:05.306557 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d884f6456-ff2h5_a6d35ac4-1084-48a9-9a96-2113aceb7f9d/manager/0.log" Jul 08 16:42:05.327866 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:05.327819 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lw85p_50398117-5339-4dec-bb94-97f207e7059d/server/0.log" Jul 08 16:42:05.487427 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:05.487389 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-bkdnv_a61a7be9-8de2-45ac-989a-c9c9ba32cfb3/manager/0.log" Jul 08 16:42:05.513022 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:05.512927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bf8d94745-bkdnv_a61a7be9-8de2-45ac-989a-c9c9ba32cfb3/copy-manifests/0.log" Jul 08 16:42:06.301665 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:06.301625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fr229_742d552f-053e-4b3c-8cca-7c961b8e60a1/konnectivity-agent/0.log" limit=1024 Jul 08 16:42:07.055556 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:07.055528 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q6nk6_6d8c70df-7396-4b64-a170-03c687246582/istio-proxy/0.log" Jul 08 16:42:07.192506 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:07.192413 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-n62rt_7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7/kube-auth-proxy/0.log" Jul 08 16:42:07.217540 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:07.217507 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/0.log" Jul 08 16:42:07.275936 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:07.275906 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/1.log" Jul 08 16:42:07.371694 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:07.371661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t5fhm_74e34c38-70d4-4242-9db2-f88eff45adb7/payload-processing/0.log" Jul 08 16:42:08.605746 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:08.605715 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4q6nk6_6d8c70df-7396-4b64-a170-03c687246582/istio-proxy/0.log" Jul 08 16:42:08.729215 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:08.729183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bddc7bb64-n62rt_7bc9b3f7-1a0e-43a4-b662-3863fcfc79c7/kube-auth-proxy/0.log" Jul 08 16:42:08.758472 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:08.758437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/0.log" Jul 08 16:42:08.823673 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:08.823636 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8jjct_d46a042e-f294-47e4-81ed-31a07a6e65e9/istio-proxy/1.log" Jul 08 16:42:08.930670 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:08.930637 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-t5fhm_74e34c38-70d4-4242-9db2-f88eff45adb7/payload-processing/0.log" Jul 08 16:42:13.886952 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:13.886875 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7t2kp_086077ba-ff82-4f8c-8fb9-a06fbc99a8d4/kube-multus/0.log" Jul 08 16:42:14.091386 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.091359 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/kube-multus-additional-cni-plugins/0.log" Jul 08 16:42:14.114653 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.114626 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/egress-router-binary-copy/0.log" Jul 08 16:42:14.138431 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.138336 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/cni-plugins/0.log" Jul 08 16:42:14.167403 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.167376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/bond-cni-plugin/0.log" Jul 08 16:42:14.189550 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.189523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/routeoverride-cni/0.log" Jul 08 16:42:14.212266 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.212236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/whereabouts-cni-bincopy/0.log" Jul 08 16:42:14.235821 ip-10-0-136-114 kubenswrapper[2572]: I0708 16:42:14.235768 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k8vlz_72823315-3130-4009-ac3d-e3b1eadd8e84/whereabouts-cni/0.log"