Jul 07 15:40:04.043906 ip-10-0-132-99 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 15:40:04.043918 ip-10-0-132-99 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 15:40:04.043925 ip-10-0-132-99 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 15:40:04.044180 ip-10-0-132-99 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 15:40:14.241678 ip-10-0-132-99 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 15:40:14.241691 ip-10-0-132-99 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eca1428d71eb485881374ad00b4ad119 -- Jul 07 15:42:06.152576 ip-10-0-132-99 systemd[1]: Starting Kubernetes Kubelet... Jul 07 15:42:08.126717 ip-10-0-132-99 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:42:08.126717 ip-10-0-132-99 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 15:42:08.126717 ip-10-0-132-99 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:42:08.126717 ip-10-0-132-99 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 15:42:08.126717 ip-10-0-132-99 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:42:08.128348 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.128196 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 15:42:08.132960 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132945 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.132960 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132959 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132963 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132967 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132970 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132974 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132977 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132980 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132983 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132987 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132990 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132993 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132996 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.132999 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133001 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133004 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133006 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133009 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133019 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133023 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.133027 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133026 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133029 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133032 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133036 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133041 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133044 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133047 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133050 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133052 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133055 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133058 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133060 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133063 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133066 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133068 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133071 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133074 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133076 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133079 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.133496 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133081 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133084 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133087 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133090 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133093 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133096 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133098 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133101 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133103 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133106 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133108 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133111 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133113 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133116 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133118 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133121 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133124 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133126 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133129 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133132 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.133976 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133134 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133137 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133139 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133142 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133149 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133152 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133154 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133157 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133159 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133162 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133164 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133167 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133170 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133172 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133175 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133178 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133180 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133189 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133192 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133194 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.134500 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133197 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133199 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133202 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133219 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133222 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133226 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133230 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133233 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133236 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133239 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133242 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133244 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133247 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133250 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133252 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133255 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133257 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133260 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133262 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.134971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.133265 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134028 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134036 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134040 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134043 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134046 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134049 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134053 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134056 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134059 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134061 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134067 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134070 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134073 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134076 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134078 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134081 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134083 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134086 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.135430 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134088 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134091 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134094 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134097 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134100 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134102 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134105 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134108 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134111 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134113 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134116 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134119 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134122 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134124 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134127 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134129 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134132 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134134 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134137 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134140 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.135919 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134142 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134145 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134147 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134164 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134168 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134171 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134174 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134177 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134180 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134183 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134186 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134188 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134191 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134195 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134198 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134201 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134218 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134221 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134224 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134227 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.136457 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134230 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134233 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134236 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134238 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134241 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134244 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134247 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134251 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134254 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134257 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134261 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134264 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134267 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134270 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134272 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134275 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134278 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134280 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134284 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.136950 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134287 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134290 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134292 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134295 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134299 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134302 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134304 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134308 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134312 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134315 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134317 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134320 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134322 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134325 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134327 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134330 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134332 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134335 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134338 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134340 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.137443 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134343 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134345 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134759 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134766 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134769 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134772 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134775 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134778 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134780 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134783 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134785 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134789 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134792 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134795 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134797 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134800 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134803 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134806 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134808 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134812 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.137933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134814 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134817 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134820 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134822 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134825 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134828 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134830 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134833 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134836 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134838 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134841 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134844 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134846 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134849 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134851 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134854 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134856 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134859 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134861 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.138431 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134864 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134867 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134869 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134872 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134875 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134880 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134883 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134886 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134888 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134891 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134894 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134896 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134899 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134902 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134904 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134907 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134909 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134912 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134915 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134918 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.138928 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134921 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134923 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134926 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134928 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134931 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134933 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134936 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134939 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134941 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134944 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134946 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134949 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134951 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134955 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134959 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134962 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134968 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134971 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134979 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.139474 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134983 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134986 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134989 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134992 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134995 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.134998 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135001 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135005 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135008 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135011 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135015 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135018 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135021 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135024 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135027 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135030 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135032 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135035 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135037 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.139986 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135040 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135042 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135045 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135047 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135119 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135126 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135132 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135137 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135141 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135144 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135151 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135155 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135159 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135168 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135172 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135175 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135178 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135182 2556 flags.go:64] FLAG: --cgroup-root="" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135186 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135188 2556 flags.go:64] FLAG: --client-ca-file="" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135191 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135194 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135201 2556 flags.go:64] FLAG: --cluster-domain="" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135217 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 15:42:08.140504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135220 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135223 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135227 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135230 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135233 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135236 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135240 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135243 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135246 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135249 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135252 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135255 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135259 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135262 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135265 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135268 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135270 2556 flags.go:64] FLAG: --enable-server="true" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135273 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135282 2556 flags.go:64] FLAG: --event-burst="100" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135285 2556 flags.go:64] FLAG: --event-qps="50" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135288 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135291 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135296 2556 flags.go:64] FLAG: --eviction-hard="" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135300 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 15:42:08.141123 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135303 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135306 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135309 2556 flags.go:64] FLAG: --eviction-soft="" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135312 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135314 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135317 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135320 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135323 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135326 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135329 2556 flags.go:64] FLAG: --feature-gates="" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135332 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135335 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135339 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135341 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135344 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135348 2556 flags.go:64] FLAG: --help="false" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135350 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135354 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135357 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135359 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135362 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135366 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135369 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 15:42:08.141771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135371 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135374 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135377 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135381 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135384 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135387 2556 flags.go:64] FLAG: --kube-reserved="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135390 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135394 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135398 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135401 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135404 2556 flags.go:64] FLAG: --lock-file="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135406 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135409 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135412 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135421 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135424 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135427 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135429 2556 flags.go:64] FLAG: --logging-format="text" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135433 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135436 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135439 2556 flags.go:64] FLAG: --manifest-url="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135442 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135447 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135450 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135454 2556 flags.go:64] FLAG: --max-pods="110" Jul 07 15:42:08.142473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135457 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135460 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135463 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135466 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135468 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135472 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135475 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135481 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135484 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135487 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135493 2556 flags.go:64] FLAG: --pod-cidr="" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135495 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135501 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135504 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135507 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135512 2556 flags.go:64] FLAG: --port="10250" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135516 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135519 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ae60fe602dbd9b14" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135522 2556 flags.go:64] FLAG: --qos-reserved="" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135525 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135528 2556 flags.go:64] FLAG: --register-node="true" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135530 2556 flags.go:64] FLAG: --register-with-taints="" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135534 2556 flags.go:64] FLAG: --registry-burst="10" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135537 2556 flags.go:64] FLAG: --registry-qps="5" Jul 07 15:42:08.143138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135540 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135542 2556 flags.go:64] FLAG: --reserved-memory="" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135546 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135549 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135552 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135554 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135557 2556 flags.go:64] FLAG: --runonce="false" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135560 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135563 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135566 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135569 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135572 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135575 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135578 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135581 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135584 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135587 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135590 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135594 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135596 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135600 2556 flags.go:64] FLAG: --system-cgroups="" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135602 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135608 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135612 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135614 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 15:42:08.143750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135619 2556 flags.go:64] FLAG: --tls-min-version="" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135622 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135625 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135628 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135631 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135634 2556 flags.go:64] FLAG: --v="2" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135637 2556 flags.go:64] FLAG: --version="false" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135641 2556 flags.go:64] FLAG: --vmodule="" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135645 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.135648 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135778 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135782 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135785 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135788 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135791 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135793 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135796 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135798 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135801 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135804 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135806 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135809 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.144599 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135811 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135815 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135819 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135823 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135826 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135829 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135832 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135835 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135839 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135842 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135845 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135849 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135851 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135854 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135857 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135860 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135863 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135865 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135868 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135870 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.145400 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135873 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135875 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135879 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135881 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135884 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135886 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135889 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135891 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135894 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135896 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135899 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135901 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135904 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135907 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135909 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135913 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135916 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135919 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135922 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135924 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.145895 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135929 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135931 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135934 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135937 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135940 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135943 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135946 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135948 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135951 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135953 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135956 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135958 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135961 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135963 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135966 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135969 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135971 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135974 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135976 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135979 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.146432 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135981 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135984 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135986 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135989 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135991 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135994 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.135997 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136000 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136003 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136005 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136008 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136010 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136014 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136019 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136022 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136025 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136028 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136031 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136035 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.146933 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136038 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136041 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136044 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136046 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136049 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136051 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136054 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.136057 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.136598 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.145399 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.145415 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.145434 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.145440 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145515 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145521 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.147502 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145524 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145527 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145531 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145534 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145537 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145539 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145542 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145545 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145548 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145551 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145553 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145556 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145559 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145562 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145564 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145567 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145571 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145575 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145579 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145583 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.147864 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145588 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145590 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145593 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145596 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145598 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145602 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145604 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145607 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145609 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145612 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145616 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145620 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145623 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145625 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145628 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145631 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145633 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145636 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145639 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145641 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.148383 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145644 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145646 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145649 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145651 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145654 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145656 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145659 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145662 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145665 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145667 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145670 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145673 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145675 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145678 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145681 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145685 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145689 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145692 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145695 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.148870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145697 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145700 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145704 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145707 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145710 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145712 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145715 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145718 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145720 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145723 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145725 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145728 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145731 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145733 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145736 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145740 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145743 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145746 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145749 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.149358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145752 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145754 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145757 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145760 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145763 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145765 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145768 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145770 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145773 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145776 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145779 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145781 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145784 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145786 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145789 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145791 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145794 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145797 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.149812 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145799 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.145804 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145930 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145937 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145940 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145943 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145946 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145949 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145952 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145954 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145957 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145959 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145962 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145965 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145968 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:42:08.150278 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145970 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145973 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145976 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145979 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145981 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145984 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145987 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145989 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145993 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145997 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.145999 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146002 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146005 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146007 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146010 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146012 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146015 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146017 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146020 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146023 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:42:08.150669 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146025 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146029 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146032 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146035 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146038 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146041 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146044 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146046 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146049 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146052 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146054 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146057 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146060 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146063 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146065 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146067 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146070 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146072 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146075 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:42:08.151156 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146078 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146080 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146083 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146085 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146088 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146091 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146093 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146096 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146098 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146101 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146103 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146106 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146108 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146111 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146113 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146116 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146118 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146121 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146123 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146125 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:42:08.151626 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146128 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146131 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146135 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146138 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146141 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146143 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146147 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146151 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146153 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146156 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146159 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146161 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146164 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146166 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146169 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146171 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146174 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146177 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146179 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:42:08.152112 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146182 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146184 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146187 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146189 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146192 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146194 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146197 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:08.146199 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.146221 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.146332 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.148350 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.149750 2556 server.go:1019] "Starting client certificate rotation" Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.149850 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:42:08.152586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.149877 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:42:08.152907 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.152486 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:42:08.153981 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.153965 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:42:08.166780 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.166762 2556 log.go:25] "Validated CRI v1 runtime API" Jul 07 15:42:08.168686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.168670 2556 log.go:25] "Validated CRI v1 image API" Jul 07 15:42:08.169508 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.169493 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 15:42:08.172839 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.172819 2556 fs.go:135] Filesystem UUIDs: map[4ccbe474-ed8a-4744-a3bc-3c6b409cfe1f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 944ce4db-3dd8-4e07-8a3b-edf701c2d9bc:/dev/nvme0n1p4] Jul 07 15:42:08.172914 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.172839 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 15:42:08.179608 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.179490 2556 manager.go:216] Machine: {Timestamp:2026-07-07 15:42:08.178018578 +0000 UTC m=+0.330796534 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102228 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a85b8c35bd205ed8db84a6e91ea1d SystemUUID:ec2a85b8-c35b-d205-ed8d-b84a6e91ea1d BootID:eca1428d-71eb-4858-8137-4ad00b4ad119 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:b1:2f:60:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:b1:2f:60:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:93:0c:51:f2:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 15:42:08.179608 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.179600 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 15:42:08.179767 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.179699 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 15:42:08.181526 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.181503 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:42:08.183002 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.182978 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 15:42:08.183127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.183003 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 15:42:08.183721 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.183711 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 15:42:08.183755 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.183723 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 15:42:08.183755 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.183730 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:42:08.184339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.184328 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:42:08.185622 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.185612 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 15:42:08.197806 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.197792 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:42:08.197957 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.197947 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 15:42:08.197989 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.197977 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 07 15:42:08.198018 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.197993 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 15:42:08.198018 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.198013 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 15:42:08.198078 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.198027 2556 kubelet.go:398] "Adding apiserver pod source" Jul 07 15:42:08.198078 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.198039 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 15:42:08.198455 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.198432 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:42:08.198513 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.198466 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:42:08.203358 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.203332 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 15:42:08.205249 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.205236 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 15:42:08.205308 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.205266 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 15:42:08.206356 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206344 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 15:42:08.206399 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206361 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 15:42:08.206399 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206368 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 15:42:08.206399 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206374 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 15:42:08.206399 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206383 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 15:42:08.206399 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206392 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206405 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206413 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206423 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206433 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206451 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 15:42:08.206547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.206457 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 15:42:08.207259 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.207250 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 15:42:08.207259 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.207259 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 15:42:08.208686 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.208664 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 15:42:08.208753 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.208688 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 15:42:08.210681 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.210669 2556 server.go:1268] "Started kubelet" Jul 07 15:42:08.210788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.210747 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 15:42:08.210851 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.210815 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 15:42:08.210965 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.210757 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 15:42:08.211468 ip-10-0-132-99 systemd[1]: Started Kubernetes Kubelet. Jul 07 15:42:08.212635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.212619 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 15:42:08.213376 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.213360 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 07 15:42:08.217029 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.217003 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 15:42:08.217885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.217871 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 15:42:08.218857 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.217936 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-99.ec2.internal.18c00c4192994f4f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-99.ec2.internal,UID:ip-10-0-132-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-99.ec2.internal,},FirstTimestamp:2026-07-07 15:42:08.210644815 +0000 UTC m=+0.363422770,LastTimestamp:2026-07-07 15:42:08.210644815 +0000 UTC m=+0.363422770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-99.ec2.internal,}" Jul 07 15:42:08.219717 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.219699 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 15:42:08.219801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.219699 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 15:42:08.220024 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.220003 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.220168 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220142 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z45sc" Jul 07 15:42:08.220380 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220357 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 15:42:08.220486 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220383 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 15:42:08.220541 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220497 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 07 15:42:08.220541 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220505 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 07 15:42:08.220649 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.220637 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 15:42:08.221031 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221012 2556 factory.go:153] Registering CRI-O factory Jul 07 15:42:08.221031 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221034 2556 factory.go:223] Registration of the crio container factory successfully Jul 07 15:42:08.221499 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221487 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 15:42:08.221499 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221499 2556 factory.go:55] Registering systemd factory Jul 07 15:42:08.221567 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221505 2556 factory.go:223] Registration of the systemd container factory successfully Jul 07 15:42:08.221567 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221520 2556 factory.go:103] Registering Raw factory Jul 07 15:42:08.221567 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.221531 2556 manager.go:1196] Started watching for new ooms in manager Jul 07 15:42:08.222086 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.222072 2556 manager.go:349] Starting recovery of all containers Jul 07 15:42:08.227761 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.227377 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 15:42:08.227761 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.227476 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 15:42:08.230369 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.230344 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z45sc" Jul 07 15:42:08.233251 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.233232 2556 manager.go:354] Recovery completed Jul 07 15:42:08.238388 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.238285 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.240363 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240274 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.240363 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240303 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.240363 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240317 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.240882 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240864 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 15:42:08.240940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240888 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.240940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240890 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 15:42:08.240940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.240921 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:42:08.241553 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.241538 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.241624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.241568 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.241624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.241583 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.257922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.257903 2556 policy_none.go:49] "None policy: Start" Jul 07 15:42:08.257922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.257920 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 15:42:08.258014 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.257931 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 15:42:08.274577 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.274561 2556 policy_none.go:47] "Start" Jul 07 15:42:08.308719 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.308699 2556 manager.go:337] "Starting Device Plugin manager" Jul 07 15:42:08.308785 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.308728 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 15:42:08.308785 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.308737 2556 server.go:87] "Starting device plugin registration server" Jul 07 15:42:08.309147 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.309135 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 15:42:08.309220 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.309150 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 15:42:08.309276 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.309262 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 15:42:08.309371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.309337 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 15:42:08.309371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.309350 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 15:42:08.309853 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.309831 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 15:42:08.309937 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.309890 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.409499 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.409427 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.410411 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.410452 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.410466 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.410493 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.411509 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.412758 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.412790 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.412813 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.412845 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.415065 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.419915 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.419934 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-99.ec2.internal\": node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.470320 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.466839 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.512976 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.512945 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal"] Jul 07 15:42:08.513057 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.513038 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.513955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.513941 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.514017 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.513969 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.514017 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.513980 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.522301 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.522279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.522400 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.522306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.531606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.531588 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.531715 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.531700 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.531763 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.531731 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.532406 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532387 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.532522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532421 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.532522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532431 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.532522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532387 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.532522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532500 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.532522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.532516 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.546897 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.546880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.546987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.546911 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:42:08.547782 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.547768 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:42:08.547782 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.547780 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-99.ec2.internal\" not found" node="ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.547878 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.547798 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:42:08.547878 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.547812 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:42:08.553957 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.553940 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-99.ec2.internal\" not found" node="ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.567331 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.567315 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.622452 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.622421 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.622452 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.622455 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.622633 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.622475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c70a691a74463fa9618f16a94c763d4e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-99.ec2.internal\" (UID: \"c70a691a74463fa9618f16a94c763d4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.622633 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.622518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.622633 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.622519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/807aab76291e7e7c2b16d7ddfb25d1e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal\" (UID: \"807aab76291e7e7c2b16d7ddfb25d1e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.668177 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.668111 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.722645 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.722615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c70a691a74463fa9618f16a94c763d4e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-99.ec2.internal\" (UID: \"c70a691a74463fa9618f16a94c763d4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.722728 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.722700 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c70a691a74463fa9618f16a94c763d4e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-99.ec2.internal\" (UID: \"c70a691a74463fa9618f16a94c763d4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.768796 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.768756 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.851234 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.851190 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.857360 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:08.857340 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:08.869356 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.869335 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:08.969518 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:08.969425 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:09.068679 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.068652 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:09.069865 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:09.069848 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:09.149474 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.149447 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 15:42:09.149939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.149614 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:42:09.149939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.149630 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:42:09.170703 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:09.170671 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:09.247074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.246962 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:37:08 +0000 UTC" deadline="2027-12-06 10:01:54.952172502 +0000 UTC" Jul 07 15:42:09.247074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.247020 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12402h19m45.705157322s" Jul 07 15:42:09.271140 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:09.271111 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-99.ec2.internal\" not found" Jul 07 15:42:09.357172 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.357144 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:09.420151 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.420124 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" Jul 07 15:42:09.433740 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.433714 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:42:09.434750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.434736 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" Jul 07 15:42:09.452317 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.452299 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:42:09.476668 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:09.476642 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807aab76291e7e7c2b16d7ddfb25d1e3.slice/crio-30f9b839c4110490855fc075a00af95c556e8a3570d2597cf9d0f692548e0ca8 WatchSource:0}: Error finding container 30f9b839c4110490855fc075a00af95c556e8a3570d2597cf9d0f692548e0ca8: Status 404 returned error can't find the container with id 30f9b839c4110490855fc075a00af95c556e8a3570d2597cf9d0f692548e0ca8 Jul 07 15:42:09.482617 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.482597 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:42:09.504477 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:09.504412 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:09.545977 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:09.545956 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70a691a74463fa9618f16a94c763d4e.slice/crio-629bce4693ac3dbb4c7bb54cb7e3984edc0de885e57fb6f84f7bfdcfdd0cb40b WatchSource:0}: Error finding container 629bce4693ac3dbb4c7bb54cb7e3984edc0de885e57fb6f84f7bfdcfdd0cb40b: Status 404 returned error can't find the container with id 629bce4693ac3dbb4c7bb54cb7e3984edc0de885e57fb6f84f7bfdcfdd0cb40b Jul 07 15:42:10.199862 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.199829 2556 apiserver.go:52] "Watching apiserver" Jul 07 15:42:10.208866 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.208838 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 15:42:10.210847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.210817 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-q6zg5","openshift-network-operator/iptables-alerter-dpxj5","kube-system/global-pull-secret-syncer-vbvnq","openshift-cluster-node-tuning-operator/tuned-kw5kc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal","openshift-multus/multus-zd4cf","openshift-multus/network-metrics-daemon-df9wq","openshift-network-diagnostics/network-check-target-xwxxm","openshift-ovn-kubernetes/ovnkube-node-brcfh","kube-system/konnectivity-agent-m7dsb","kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2","openshift-dns/node-resolver-w6b4s","openshift-image-registry/node-ca-nzbf2"] Jul 07 15:42:10.212734 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.212714 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.212843 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.212800 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:10.214328 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.214263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:10.214483 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.214328 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:10.215103 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.215084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.215244 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.215150 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:10.216419 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.216394 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.218146 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.217626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.218362 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.218339 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mcb7s\"" Jul 07 15:42:10.218675 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.218503 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.218675 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.218609 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.219953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.219027 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.219953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.219518 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 15:42:10.219953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.219804 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xt7wk\"" Jul 07 15:42:10.220180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220118 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.220341 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220319 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 15:42:10.220624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220456 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.220624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220495 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 15:42:10.220624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220565 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.220624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.220613 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 15:42:10.221254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.221124 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2p89f\"" Jul 07 15:42:10.221254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.221180 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 15:42:10.221997 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.221922 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.222409 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.222377 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hjx4w\"" Jul 07 15:42:10.222894 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.222854 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 15:42:10.223109 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.223090 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 15:42:10.223197 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.222923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 15:42:10.223284 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.222961 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.223284 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.223011 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.223382 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.222889 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 15:42:10.223780 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.223762 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.223892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.223871 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pmqks\"" Jul 07 15:42:10.224015 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.223986 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.224273 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.224254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.225726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.225703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.226108 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.226086 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.226511 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.226114 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.226511 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.226422 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 15:42:10.226824 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.226806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d74zx\"" Jul 07 15:42:10.227120 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.227098 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.227758 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.227611 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 15:42:10.228536 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.228519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.229017 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229000 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xs6gk\"" Jul 07 15:42:10.229101 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229065 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 15:42:10.229364 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-ovn\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.229446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:10.229446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysconfig\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.229446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229428 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-tuned\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.229573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229465 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-etc-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.229573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-bin\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.229573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-sys\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.229691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-k8s-cni-cncf-io\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.229691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdxnl\" (UniqueName: \"kubernetes.io/projected/4ab7b128-9f67-4c02-9c08-bf81f91ad434-kube-api-access-kdxnl\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.229691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-env-overrides\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.229691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-conf\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.229960 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-systemd\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230061 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-run\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230061 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.229998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7m9\" (UniqueName: \"kubernetes.io/projected/b679eb80-e807-42dc-a614-7a49169a655f-kube-api-access-jc7m9\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.230061 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-os-release\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-kubelet\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-netns\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-dbus\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-os-release\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmt8t\"" Jul 07 15:42:10.230228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cni-binary-copy\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230268 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s7jf\" (UniqueName: \"kubernetes.io/projected/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-kube-api-access-7s7jf\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-modprobe-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-kubernetes\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-var-lib-kubelet\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230451 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-tmp\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cnibin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-socket-dir-parent\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-script-lib\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-lib-modules\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-netns\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-conf-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-daemon-config\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-systemd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.230772 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79p7r\" (UniqueName: \"kubernetes.io/projected/cfad1eda-5f68-4e5f-81df-a90089f5993d-kube-api-access-79p7r\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-hostroot\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230832 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-etc-kubernetes\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-systemd-units\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-node-log\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230960 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-config\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.230983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-system-cni-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-slash\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231033 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231058 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87jv\" (UniqueName: \"kubernetes.io/projected/0b766e02-00ff-4f29-a1cd-08a835c4a99f-kube-api-access-b87jv\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-bin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-multus\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231161 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-multus-certs\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-kubelet\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.231568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovn-node-metrics-cert\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-hosts-file\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231321 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-var-lib-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-log-socket\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-host\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231934 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cnibin\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231961 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.231977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn54w\" (UniqueName: \"kubernetes.io/projected/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-kube-api-access-rn54w\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-system-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-netd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-tmp-dir\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232072 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-kubelet-config\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232172 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232392 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.232516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232433 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 15:42:10.233462 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232472 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 15:42:10.233462 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.232677 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2n5p4\"" Jul 07 15:42:10.238446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.238413 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:42:10.251589 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.251565 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:10.262787 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.262648 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sj9b2" Jul 07 15:42:10.273599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.273579 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sj9b2" Jul 07 15:42:10.322425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.322397 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 15:42:10.332618 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7m9\" (UniqueName: \"kubernetes.io/projected/b679eb80-e807-42dc-a614-7a49169a655f-kube-api-access-jc7m9\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.332733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.332733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-os-release\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.332733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-kubelet\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.332733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-netns\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.332733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-dbus\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5239-4894-481d-94fe-2c5f15649696-konnectivity-ca\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-os-release\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cni-binary-copy\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s7jf\" (UniqueName: \"kubernetes.io/projected/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-kube-api-access-7s7jf\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-modprobe-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-kubernetes\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-var-lib-kubelet\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-tmp\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.332979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.332980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cnibin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-socket-dir-parent\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8bb7b0d-83b3-4093-8134-aed3728db1b9-serviceca\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-script-lib\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333085 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-os-release\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-lib-modules\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-netns\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-conf-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-daemon-config\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333233 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-systemd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79p7r\" (UniqueName: \"kubernetes.io/projected/cfad1eda-5f68-4e5f-81df-a90089f5993d-kube-api-access-79p7r\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-hostroot\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-etc-kubernetes\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.333476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-systemd-units\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333471 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-node-log\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-config\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8bb7b0d-83b3-4093-8134-aed3728db1b9-host\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-os-release\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-kubelet\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rfq\" (UniqueName: \"kubernetes.io/projected/9df8274b-eace-41f9-9a34-afd8a4e34018-kube-api-access-r4rfq\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-netns\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-system-cni-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-slash\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87jv\" (UniqueName: \"kubernetes.io/projected/0b766e02-00ff-4f29-a1cd-08a835c4a99f-kube-api-access-b87jv\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333745 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-dbus\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-bin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.334334 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333789 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-multus\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-multus-certs\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-kubelet\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovn-node-metrics-cert\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-hosts-file\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.333977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-var-lib-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-log-socket\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-host\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334139 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cnibin\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn54w\" (UniqueName: \"kubernetes.io/projected/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-kube-api-access-rn54w\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-system-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.335132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-netd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-tmp-dir\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-kubelet-config\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334365 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5v7\" (UniqueName: \"kubernetes.io/projected/022e8524-2a0b-45a0-bced-7855540807e3-kube-api-access-gw5v7\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-ovn\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysconfig\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-tuned\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-device-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6cf5239-4894-481d-94fe-2c5f15649696-agent-certs\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8x4f\" (UniqueName: \"kubernetes.io/projected/b8bb7b0d-83b3-4093-8134-aed3728db1b9-kube-api-access-k8x4f\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-etc-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-bin\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-sys\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9df8274b-eace-41f9-9a34-afd8a4e34018-iptables-alerter-script\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.335972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-k8s-cni-cncf-io\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdxnl\" (UniqueName: \"kubernetes.io/projected/4ab7b128-9f67-4c02-9c08-bf81f91ad434-kube-api-access-kdxnl\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334782 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-env-overrides\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cni-binary-copy\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334887 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.334895 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334936 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-var-lib-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.334980 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-log-socket\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335063 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-run-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-modprobe-d\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-host\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335165 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cnibin\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335178 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-var-lib-kubelet\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-kubernetes\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335338 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-hostroot\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335392 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-etc-kubernetes\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-systemd-units\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.336788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-node-log\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335482 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-system-cni-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335562 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-netd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335868 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-tmp-dir\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335948 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/487e2f38-5580-4e12-b413-a483cba73d9d-kubelet-config\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.335996 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-config\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336003 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-ovn\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336078 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-system-cni-dir\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-slash\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336161 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysconfig\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336778 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-bin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-var-lib-cni-multus\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336926 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-multus-certs\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.337702 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.336970 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-kubelet\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.338440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.337771 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovnkube-script-lib\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.338440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.337829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-cnibin\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.338440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.337878 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-socket-dir-parent\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.338440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.338440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-conf-dir\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.338657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338508 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-lib-modules\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.338657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338546 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-netns\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.338657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338621 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-etc-openvswitch\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.338788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-host-cni-bin\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.338788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-sys\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.338788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.338764 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-hosts-file\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.339046 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339022 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ab7b128-9f67-4c02-9c08-bf81f91ad434-host-run-k8s-cni-cncf-io\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.339136 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-conf\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339136 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-systemd\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339130 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-tmp\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339139 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-run\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339178 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-run\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339179 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df8274b-eace-41f9-9a34-afd8a4e34018-host-slash\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.339291 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.339265 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.839231024 +0000 UTC m=+2.992008973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-sysctl-conf\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-systemd\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b766e02-00ff-4f29-a1cd-08a835c4a99f-run-systemd\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339451 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b766e02-00ff-4f29-a1cd-08a835c4a99f-env-overrides\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.339508 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:10.339652 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.339560 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.839547177 +0000 UTC m=+2.992325120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:10.340060 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.339780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ab7b128-9f67-4c02-9c08-bf81f91ad434-multus-daemon-config\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.340710 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.340244 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfad1eda-5f68-4e5f-81df-a90089f5993d-etc-tuned\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.343766 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.343706 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7m9\" (UniqueName: \"kubernetes.io/projected/b679eb80-e807-42dc-a614-7a49169a655f-kube-api-access-jc7m9\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.344147 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.344084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b766e02-00ff-4f29-a1cd-08a835c4a99f-ovn-node-metrics-cert\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.345062 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.344898 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:10.345062 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.344925 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:10.345062 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.344940 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:10.345062 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.344993 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.844977906 +0000 UTC m=+2.997755867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:10.345447 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.345410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s7jf\" (UniqueName: \"kubernetes.io/projected/cfd7b670-a8ee-43c6-9d3a-eca3d6583735-kube-api-access-7s7jf\") pod \"node-resolver-w6b4s\" (UID: \"cfd7b670-a8ee-43c6-9d3a-eca3d6583735\") " pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.345747 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.345729 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn54w\" (UniqueName: \"kubernetes.io/projected/8d2c5de2-f62d-4f46-87b1-1f11bc6a318b-kube-api-access-rn54w\") pod \"multus-additional-cni-plugins-q6zg5\" (UID: \"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b\") " pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.346908 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.346885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79p7r\" (UniqueName: \"kubernetes.io/projected/cfad1eda-5f68-4e5f-81df-a90089f5993d-kube-api-access-79p7r\") pod \"tuned-kw5kc\" (UID: \"cfad1eda-5f68-4e5f-81df-a90089f5993d\") " pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.350717 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.350674 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87jv\" (UniqueName: \"kubernetes.io/projected/0b766e02-00ff-4f29-a1cd-08a835c4a99f-kube-api-access-b87jv\") pod \"ovnkube-node-brcfh\" (UID: \"0b766e02-00ff-4f29-a1cd-08a835c4a99f\") " pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.352354 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.352310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdxnl\" (UniqueName: \"kubernetes.io/projected/4ab7b128-9f67-4c02-9c08-bf81f91ad434-kube-api-access-kdxnl\") pod \"multus-zd4cf\" (UID: \"4ab7b128-9f67-4c02-9c08-bf81f91ad434\") " pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.418654 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.418578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" event={"ID":"c70a691a74463fa9618f16a94c763d4e","Type":"ContainerStarted","Data":"629bce4693ac3dbb4c7bb54cb7e3984edc0de885e57fb6f84f7bfdcfdd0cb40b"} Jul 07 15:42:10.420247 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.420220 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" event={"ID":"807aab76291e7e7c2b16d7ddfb25d1e3","Type":"ContainerStarted","Data":"30f9b839c4110490855fc075a00af95c556e8a3570d2597cf9d0f692548e0ca8"} Jul 07 15:42:10.440571 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.440316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5239-4894-481d-94fe-2c5f15649696-konnectivity-ca\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.441067 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8bb7b0d-83b3-4093-8134-aed3728db1b9-serviceca\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.441223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.441223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.441352 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-registration-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.441352 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8bb7b0d-83b3-4093-8134-aed3728db1b9-serviceca\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.441461 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441402 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-socket-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.441521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8bb7b0d-83b3-4093-8134-aed3728db1b9-host\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.441574 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.441622 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441574 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rfq\" (UniqueName: \"kubernetes.io/projected/9df8274b-eace-41f9-9a34-afd8a4e34018-kube-api-access-r4rfq\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.441830 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6cf5239-4894-481d-94fe-2c5f15649696-konnectivity-ca\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.441905 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441835 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8bb7b0d-83b3-4093-8134-aed3728db1b9-host\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.441905 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.442019 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.441931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5v7\" (UniqueName: \"kubernetes.io/projected/022e8524-2a0b-45a0-bced-7855540807e3-kube-api-access-gw5v7\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.442019 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-device-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.442115 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6cf5239-4894-481d-94fe-2c5f15649696-agent-certs\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.442115 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8x4f\" (UniqueName: \"kubernetes.io/projected/b8bb7b0d-83b3-4093-8134-aed3728db1b9-kube-api-access-k8x4f\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.442226 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.442226 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9df8274b-eace-41f9-9a34-afd8a4e34018-iptables-alerter-script\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.442339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442315 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df8274b-eace-41f9-9a34-afd8a4e34018-host-slash\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.442420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df8274b-eace-41f9-9a34-afd8a4e34018-host-slash\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.442420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442388 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-sys-fs\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.442768 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.443180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442830 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.443180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.442940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/022e8524-2a0b-45a0-bced-7855540807e3-device-dir\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.443487 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.443469 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9df8274b-eace-41f9-9a34-afd8a4e34018-iptables-alerter-script\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.445901 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.445856 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6cf5239-4894-481d-94fe-2c5f15649696-agent-certs\") pod \"konnectivity-agent-m7dsb\" (UID: \"e6cf5239-4894-481d-94fe-2c5f15649696\") " pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.452402 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.452326 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8x4f\" (UniqueName: \"kubernetes.io/projected/b8bb7b0d-83b3-4093-8134-aed3728db1b9-kube-api-access-k8x4f\") pod \"node-ca-nzbf2\" (UID: \"b8bb7b0d-83b3-4093-8134-aed3728db1b9\") " pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.453599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.453558 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5v7\" (UniqueName: \"kubernetes.io/projected/022e8524-2a0b-45a0-bced-7855540807e3-kube-api-access-gw5v7\") pod \"aws-ebs-csi-driver-node-t2hn2\" (UID: \"022e8524-2a0b-45a0-bced-7855540807e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.453693 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.453654 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rfq\" (UniqueName: \"kubernetes.io/projected/9df8274b-eace-41f9-9a34-afd8a4e34018-kube-api-access-r4rfq\") pod \"iptables-alerter-dpxj5\" (UID: \"9df8274b-eace-41f9-9a34-afd8a4e34018\") " pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.530201 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.530164 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" Jul 07 15:42:10.541844 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.541820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" Jul 07 15:42:10.543135 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:10.543105 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfad1eda_5f68_4e5f_81df_a90089f5993d.slice/crio-ba782febd8d5eaa9e281fb54129fab49cdcfb243e5163442b384815a2d80eb23 WatchSource:0}: Error finding container ba782febd8d5eaa9e281fb54129fab49cdcfb243e5163442b384815a2d80eb23: Status 404 returned error can't find the container with id ba782febd8d5eaa9e281fb54129fab49cdcfb243e5163442b384815a2d80eb23 Jul 07 15:42:10.552074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.552054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zd4cf" Jul 07 15:42:10.554642 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:10.554614 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2c5de2_f62d_4f46_87b1_1f11bc6a318b.slice/crio-f35d1af10962b405b08c400e48539ae29d5dc3a2df04c442a3a851a1d5e49b03 WatchSource:0}: Error finding container f35d1af10962b405b08c400e48539ae29d5dc3a2df04c442a3a851a1d5e49b03: Status 404 returned error can't find the container with id f35d1af10962b405b08c400e48539ae29d5dc3a2df04c442a3a851a1d5e49b03 Jul 07 15:42:10.558581 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.558560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:10.566603 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.566392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w6b4s" Jul 07 15:42:10.566792 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:10.566753 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab7b128_9f67_4c02_9c08_bf81f91ad434.slice/crio-ca161e3a85ee679b1ce23aef4b26db96c7d5d2700411f8d60583b28e91dcf3c1 WatchSource:0}: Error finding container ca161e3a85ee679b1ce23aef4b26db96c7d5d2700411f8d60583b28e91dcf3c1: Status 404 returned error can't find the container with id ca161e3a85ee679b1ce23aef4b26db96c7d5d2700411f8d60583b28e91dcf3c1 Jul 07 15:42:10.571030 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:10.571005 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b766e02_00ff_4f29_a1cd_08a835c4a99f.slice/crio-e6a1b27eb6e41116d257d1b2c10ee27fd113c670429edac458a760bfc8179b48 WatchSource:0}: Error finding container e6a1b27eb6e41116d257d1b2c10ee27fd113c670429edac458a760bfc8179b48: Status 404 returned error can't find the container with id e6a1b27eb6e41116d257d1b2c10ee27fd113c670429edac458a760bfc8179b48 Jul 07 15:42:10.584276 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.584162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpxj5" Jul 07 15:42:10.593921 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.593899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:10.602466 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.602444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzbf2" Jul 07 15:42:10.608387 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.608367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" Jul 07 15:42:10.844705 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.844627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:10.844886 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.844756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:10.844886 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.844809 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:10.844886 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.844864 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:10.845001 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.844888 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:11.844866895 +0000 UTC m=+3.997644846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:10.845001 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.844914 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:11.84489736 +0000 UTC m=+3.997675306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:10.945499 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:10.945458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:10.945671 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.945616 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:10.945671 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.945634 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:10.945671 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.945645 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:10.945828 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:10.945697 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:11.945677641 +0000 UTC m=+4.098455584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:11.276617 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.276499 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:37:10 +0000 UTC" deadline="2028-02-13 06:01:53.78158455 +0000 UTC" Jul 07 15:42:11.276617 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.276578 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14054h19m42.505025541s" Jul 07 15:42:11.413442 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.413401 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:11.413615 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.413540 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:11.423054 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.423025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"e6a1b27eb6e41116d257d1b2c10ee27fd113c670429edac458a760bfc8179b48"} Jul 07 15:42:11.424316 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.424293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zd4cf" event={"ID":"4ab7b128-9f67-4c02-9c08-bf81f91ad434","Type":"ContainerStarted","Data":"ca161e3a85ee679b1ce23aef4b26db96c7d5d2700411f8d60583b28e91dcf3c1"} Jul 07 15:42:11.425578 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.425550 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerStarted","Data":"f35d1af10962b405b08c400e48539ae29d5dc3a2df04c442a3a851a1d5e49b03"} Jul 07 15:42:11.426778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.426748 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" event={"ID":"cfad1eda-5f68-4e5f-81df-a90089f5993d","Type":"ContainerStarted","Data":"ba782febd8d5eaa9e281fb54129fab49cdcfb243e5163442b384815a2d80eb23"} Jul 07 15:42:11.563559 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:11.563531 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd7b670_a8ee_43c6_9d3a_eca3d6583735.slice/crio-c28376e79fae85760f3f40e276768b2e1acc26997556422e2309f35283fb96ab WatchSource:0}: Error finding container c28376e79fae85760f3f40e276768b2e1acc26997556422e2309f35283fb96ab: Status 404 returned error can't find the container with id c28376e79fae85760f3f40e276768b2e1acc26997556422e2309f35283fb96ab Jul 07 15:42:11.573749 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:11.573717 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df8274b_eace_41f9_9a34_afd8a4e34018.slice/crio-9f6e9b1426c7d17952b3ea8c841e91a2c7e54d12013208441885f7ccca0e56a7 WatchSource:0}: Error finding container 9f6e9b1426c7d17952b3ea8c841e91a2c7e54d12013208441885f7ccca0e56a7: Status 404 returned error can't find the container with id 9f6e9b1426c7d17952b3ea8c841e91a2c7e54d12013208441885f7ccca0e56a7 Jul 07 15:42:11.574831 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:11.574807 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cf5239_4894_481d_94fe_2c5f15649696.slice/crio-de6037b738f8f32dba4a3c1c54e272d7318f9ff5eda127277a3fd34b2e8cca08 WatchSource:0}: Error finding container de6037b738f8f32dba4a3c1c54e272d7318f9ff5eda127277a3fd34b2e8cca08: Status 404 returned error can't find the container with id de6037b738f8f32dba4a3c1c54e272d7318f9ff5eda127277a3fd34b2e8cca08 Jul 07 15:42:11.575519 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:11.575493 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bb7b0d_83b3_4093_8134_aed3728db1b9.slice/crio-b3f1099633c0238e771f1c8048b1c72fb4f84cd5b891d93e907688de668c9363 WatchSource:0}: Error finding container b3f1099633c0238e771f1c8048b1c72fb4f84cd5b891d93e907688de668c9363: Status 404 returned error can't find the container with id b3f1099633c0238e771f1c8048b1c72fb4f84cd5b891d93e907688de668c9363 Jul 07 15:42:11.576943 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:11.576917 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022e8524_2a0b_45a0_bced_7855540807e3.slice/crio-8a4d6c6f5b677be587661de32d8d0063b8c58a31b311e0ef40f5e9c2efb2d16a WatchSource:0}: Error finding container 8a4d6c6f5b677be587661de32d8d0063b8c58a31b311e0ef40f5e9c2efb2d16a: Status 404 returned error can't find the container with id 8a4d6c6f5b677be587661de32d8d0063b8c58a31b311e0ef40f5e9c2efb2d16a Jul 07 15:42:11.853300 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.852935 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:11.853300 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.853279 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:11.853497 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.853365 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:13.853345709 +0000 UTC m=+6.006123678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:11.853689 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.853584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:11.853689 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.853658 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:11.853864 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.853710 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:13.853695223 +0000 UTC m=+6.006473177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:11.954441 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:11.954108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:11.954441 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.954322 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:11.954441 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.954340 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:11.954441 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.954378 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:11.954441 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:11.954443 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:13.954416255 +0000 UTC m=+6.107194217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:12.119034 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.118949 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:42:12.277051 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.277006 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:37:10 +0000 UTC" deadline="2028-04-18 02:13:09.864570292 +0000 UTC" Jul 07 15:42:12.277051 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.277049 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15610h30m57.587525452s" Jul 07 15:42:12.416243 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.413049 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:12.416243 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:12.413178 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:12.416243 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.413585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:12.416243 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:12.413672 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:12.447967 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.447931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" event={"ID":"022e8524-2a0b-45a0-bced-7855540807e3","Type":"ContainerStarted","Data":"8a4d6c6f5b677be587661de32d8d0063b8c58a31b311e0ef40f5e9c2efb2d16a"} Jul 07 15:42:12.463535 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.463447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzbf2" event={"ID":"b8bb7b0d-83b3-4093-8134-aed3728db1b9","Type":"ContainerStarted","Data":"b3f1099633c0238e771f1c8048b1c72fb4f84cd5b891d93e907688de668c9363"} Jul 07 15:42:12.476177 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.476084 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w6b4s" event={"ID":"cfd7b670-a8ee-43c6-9d3a-eca3d6583735","Type":"ContainerStarted","Data":"c28376e79fae85760f3f40e276768b2e1acc26997556422e2309f35283fb96ab"} Jul 07 15:42:12.481289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.480815 2556 generic.go:356] "Generic (PLEG): container finished" podID="807aab76291e7e7c2b16d7ddfb25d1e3" containerID="96e37dfbb23132c4054bea798c7762a3b39b0a437e546487deaa151cb41af181" exitCode=0 Jul 07 15:42:12.481289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.481159 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" event={"ID":"807aab76291e7e7c2b16d7ddfb25d1e3","Type":"ContainerDied","Data":"96e37dfbb23132c4054bea798c7762a3b39b0a437e546487deaa151cb41af181"} Jul 07 15:42:12.491987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.491959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m7dsb" event={"ID":"e6cf5239-4894-481d-94fe-2c5f15649696","Type":"ContainerStarted","Data":"de6037b738f8f32dba4a3c1c54e272d7318f9ff5eda127277a3fd34b2e8cca08"} Jul 07 15:42:12.501725 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.500432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpxj5" event={"ID":"9df8274b-eace-41f9-9a34-afd8a4e34018","Type":"ContainerStarted","Data":"9f6e9b1426c7d17952b3ea8c841e91a2c7e54d12013208441885f7ccca0e56a7"} Jul 07 15:42:12.510682 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.510640 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" event={"ID":"c70a691a74463fa9618f16a94c763d4e","Type":"ContainerStarted","Data":"eb2ce9a78435de9b2208483cb35d3254e9506b43e96b3e03a591019fcb7332d6"} Jul 07 15:42:12.530061 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:12.529236 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-99.ec2.internal" podStartSLOduration=3.529201157 podStartE2EDuration="3.529201157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:12.528912832 +0000 UTC m=+4.681690797" watchObservedRunningTime="2026-07-07 15:42:12.529201157 +0000 UTC m=+4.681979121" Jul 07 15:42:13.413681 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:13.413191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:13.413681 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.413347 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:13.543645 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:13.540399 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" event={"ID":"807aab76291e7e7c2b16d7ddfb25d1e3","Type":"ContainerStarted","Data":"e2781a467c9adfd86e176a4f9549f12babdbb86ce88aa28a3e8e293d64d62997"} Jul 07 15:42:13.871224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:13.871175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:13.871398 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:13.871283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:13.871484 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.871403 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:13.871484 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.871462 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:17.871444978 +0000 UTC m=+10.024222925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:13.871884 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.871860 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:13.871974 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.871917 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:17.871900677 +0000 UTC m=+10.024678620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:13.972585 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:13.971933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:13.972585 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.972112 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:13.972585 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.972131 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:13.972585 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.972144 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:13.972585 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:13.972219 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:17.972185233 +0000 UTC m=+10.124963176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:14.413267 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:14.413163 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:14.413453 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:14.413370 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:14.413782 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:14.413765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:14.414144 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:14.413855 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:15.413886 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:15.413856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:15.414313 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:15.414006 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:16.413137 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:16.413104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:16.413335 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:16.413242 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:16.413335 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:16.413305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:16.413476 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:16.413368 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:17.414186 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:17.413802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:17.414186 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:17.413958 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:17.906935 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:17.906817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:17.906935 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:17.906914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:17.907184 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:17.906974 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:17.907184 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:17.907049 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:25.907027295 +0000 UTC m=+18.059805240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:17.907184 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:17.907053 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:17.907184 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:17.907108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:25.907090198 +0000 UTC m=+18.059868145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:18.007745 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:18.007707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:18.007909 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.007887 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:18.007909 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.007908 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:18.008026 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.007921 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:18.008026 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.007983 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:26.007965334 +0000 UTC m=+18.160743284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:18.414390 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:18.414324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:18.414844 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.414439 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:18.414844 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:18.414508 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:18.414844 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:18.414614 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:19.413520 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:19.413426 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:19.413671 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:19.413571 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:20.413412 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:20.413082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:20.413412 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:20.413128 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:20.413412 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:20.413238 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:20.413965 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:20.413617 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:21.413621 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:21.413590 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:21.413993 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:21.413716 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:22.413158 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:22.413083 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:22.413336 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:22.413189 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:22.413336 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:22.413279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:22.413445 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:22.413388 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:23.413033 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:23.412997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:23.413468 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:23.413119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:24.413477 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:24.413437 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:24.413930 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:24.413437 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:24.413930 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:24.413561 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:24.413930 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:24.413648 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:25.414044 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:25.414006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:25.414544 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:25.414158 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:25.967962 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:25.967923 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:25.968196 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:25.967986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:25.968196 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:25.968100 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:25.968196 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:25.968181 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:41.96815816 +0000 UTC m=+34.120936109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:25.968196 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:25.968104 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:25.968467 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:25.968268 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:41.96825326 +0000 UTC m=+34.121031205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:26.069117 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:26.069049 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:26.069312 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.069236 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:26.069312 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.069258 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:26.069312 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.069273 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:26.069458 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.069342 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:42:42.069323395 +0000 UTC m=+34.222101341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:26.414066 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:26.414034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:26.414578 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:26.414034 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:26.414578 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.414172 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:26.414578 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:26.414222 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:27.413362 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:27.413326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:27.413539 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:27.413459 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:28.418721 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:28.418689 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:28.419192 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:28.418879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:28.419192 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:28.418868 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:28.419192 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:28.418966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:29.413341 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:29.413304 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:29.413534 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:29.413450 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:30.413793 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.413595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:30.414274 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.413643 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:30.414274 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:30.413909 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:30.414274 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:30.413934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:30.574865 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.574836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzbf2" event={"ID":"b8bb7b0d-83b3-4093-8134-aed3728db1b9","Type":"ContainerStarted","Data":"6cec9121364686a5c43ab4ffb6d57e6fe4b1098e26a0acde01402597b64edfbc"} Jul 07 15:42:30.576409 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.576381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w6b4s" event={"ID":"cfd7b670-a8ee-43c6-9d3a-eca3d6583735","Type":"ContainerStarted","Data":"bf55df2c34dad68350e7c8c6cc57ea5fa18113ff743f32626ef4d9d87ed1f08c"} Jul 07 15:42:30.577714 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.577693 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="7ec6bb200b4b9a37d327c742841392f55fea3841638627f2231a76670d787720" exitCode=0 Jul 07 15:42:30.577798 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.577771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"7ec6bb200b4b9a37d327c742841392f55fea3841638627f2231a76670d787720"} Jul 07 15:42:30.579092 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.579058 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m7dsb" event={"ID":"e6cf5239-4894-481d-94fe-2c5f15649696","Type":"ContainerStarted","Data":"b09873e019ea8e1150e1e84e6d508d1fae63906d8b81df25527361fe404b0ca1"} Jul 07 15:42:30.581403 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:42:30.581706 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581688 2556 generic.go:356] "Generic (PLEG): container finished" podID="0b766e02-00ff-4f29-a1cd-08a835c4a99f" containerID="c1a617999a08278c929042cf3f22876e27d4b8577582bf859fd3f5cf033abfaf" exitCode=1 Jul 07 15:42:30.581764 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581749 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"1e464ee6e158b4f0988029bb3803109b8a8f4c06f0240183ba74e6194fc9ed86"} Jul 07 15:42:30.581824 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581803 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"8fa1b52405b8ab6a6a48202161486dc366b10faa4160419632380421c9100ab7"} Jul 07 15:42:30.581880 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581850 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"3b499d2e4e49f0aef1a8d6681190bf56d602348918a80635eeb882d73d154051"} Jul 07 15:42:30.581932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581880 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerDied","Data":"c1a617999a08278c929042cf3f22876e27d4b8577582bf859fd3f5cf033abfaf"} Jul 07 15:42:30.581932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.581908 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"59cd89c3339a7c61b27be4d1b9937e04250fc0edd3c7749debf11bfa40fed672"} Jul 07 15:42:30.583145 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.583126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zd4cf" event={"ID":"4ab7b128-9f67-4c02-9c08-bf81f91ad434","Type":"ContainerStarted","Data":"bded763df711fa02fa8f7bbf7a938742c7e669cf1997cb314dd0ac9f518b7afd"} Jul 07 15:42:30.584525 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.584419 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" event={"ID":"cfad1eda-5f68-4e5f-81df-a90089f5993d","Type":"ContainerStarted","Data":"1a9c95acec0aecf1fd7ecb3afd90406eb50fe8f402162a86192ab5f39f88a799"} Jul 07 15:42:30.585782 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.585764 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" event={"ID":"022e8524-2a0b-45a0-bced-7855540807e3","Type":"ContainerStarted","Data":"1796acad5d579972b9b01f1758d9f2233dc61095d46a2339cd7bc545841f1df3"} Jul 07 15:42:30.601888 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.601841 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-99.ec2.internal" podStartSLOduration=21.601823991 podStartE2EDuration="21.601823991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:13.574857779 +0000 UTC m=+5.727635742" watchObservedRunningTime="2026-07-07 15:42:30.601823991 +0000 UTC m=+22.754601957" Jul 07 15:42:30.633193 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.633134 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m7dsb" podStartSLOduration=4.350985665 podStartE2EDuration="22.633114982s" totalImagesPullingTime="18.282129317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.632899232 +0000 UTC m=+22.785677200" watchObservedRunningTime="2026-07-07 15:42:30.633114982 +0000 UTC m=+22.785892948" Jul 07 15:42:30.633532 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.633492 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nzbf2" podStartSLOduration=4.351273552 podStartE2EDuration="22.633483704s" totalImagesPullingTime="18.282210152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.601608138 +0000 UTC m=+22.754386102" watchObservedRunningTime="2026-07-07 15:42:30.633483704 +0000 UTC m=+22.786261670" Jul 07 15:42:30.660515 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.660414 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kw5kc" podStartSLOduration=3.333787427 podStartE2EDuration="22.660405363s" totalImagesPullingTime="19.326617936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.659981269 +0000 UTC m=+22.812759252" watchObservedRunningTime="2026-07-07 15:42:30.660405363 +0000 UTC m=+22.813183334" Jul 07 15:42:30.683053 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.683000 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zd4cf" podStartSLOduration=3.326985347 podStartE2EDuration="22.682979482s" totalImagesPullingTime="19.355994135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.682390288 +0000 UTC m=+22.835168253" watchObservedRunningTime="2026-07-07 15:42:30.682979482 +0000 UTC m=+22.835757449" Jul 07 15:42:30.708901 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.708838 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w6b4s" podStartSLOduration=4.402614669 podStartE2EDuration="22.708818872s" totalImagesPullingTime="18.306204203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:30.707680766 +0000 UTC m=+22.860458731" watchObservedRunningTime="2026-07-07 15:42:30.708818872 +0000 UTC m=+22.861596838" Jul 07 15:42:30.750947 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.750908 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:30.848410 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.848361 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:30.934759 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:30.934684 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:31.413779 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.413754 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:31.413945 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:31.413886 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:31.444699 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.444670 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 15:42:31.590773 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.590732 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" event={"ID":"022e8524-2a0b-45a0-bced-7855540807e3","Type":"ContainerStarted","Data":"54996f55768158511006c289ae455ffdf8f6895c9c4cdbf613c3f19cf9878bda"} Jul 07 15:42:31.592328 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.592290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpxj5" event={"ID":"9df8274b-eace-41f9-9a34-afd8a4e34018","Type":"ContainerStarted","Data":"cc2561beb2089ec446231cf9ef07a8328c5ac017608041d30d541c6d721f432e"} Jul 07 15:42:31.595381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.595362 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:42:31.595965 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.595869 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"2797081a6bb89c39d96b0b5cea632c664fa497900dfe32f8060a16690fd10890"} Jul 07 15:42:31.612968 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.612921 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpxj5" podStartSLOduration=5.317357259 podStartE2EDuration="23.612903614s" totalImagesPullingTime="18.295546355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:31.612863646 +0000 UTC m=+23.765641612" watchObservedRunningTime="2026-07-07 15:42:31.612903614 +0000 UTC m=+23.765681579" Jul 07 15:42:31.750852 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.750815 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:31.831048 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:31.831015 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:32.322638 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.322520 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:42:31.444690693Z","UUID":"d34af490-c0ae-4a40-99c9-50ee0a5322d0","Handler":null,"Name":"","Endpoint":""} Jul 07 15:42:32.324348 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.324317 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 15:42:32.324469 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.324363 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 15:42:32.413344 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.413311 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:32.413344 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.413358 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:32.413583 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:32.413444 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:32.413583 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:32.413570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:32.438884 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.438853 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:32.517398 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:32.517361 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:33.177775 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.177598 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:33.254521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.254487 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:33.413041 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.413014 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:33.413197 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:33.413140 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:33.603299 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.603271 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:42:33.603753 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.603696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"205b1354e7735d42fcc3f720c04389c369a9b263e6fbc5ecf0ca54fad596c823"} Jul 07 15:42:33.605995 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.605967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" event={"ID":"022e8524-2a0b-45a0-bced-7855540807e3","Type":"ContainerStarted","Data":"c87f17d8728cfd8ae0551a561926087e2d20dfcf4546820e2efabadfa23b02f2"} Jul 07 15:42:33.626299 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.626256 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2hn2" podStartSLOduration=4.982736938 podStartE2EDuration="25.626239596s" totalImagesPullingTime="20.643502658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:33.625898487 +0000 UTC m=+25.778676452" watchObservedRunningTime="2026-07-07 15:42:33.626239596 +0000 UTC m=+25.779017558" Jul 07 15:42:33.813483 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.813432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:33.887497 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:33.887414 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:34.413835 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:34.413804 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:34.414150 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:34.413809 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:34.414150 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:34.413932 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:34.414150 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:34.414008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:34.946319 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:34.946287 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:34.947159 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:34.947141 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:35.413524 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.413284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:35.413679 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:35.413652 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:35.612521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.612489 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="c3e48f00766b1b22d1dbd0e49681b6d31185bb173c60a1fb2b6eb8d0eaed8aa9" exitCode=0 Jul 07 15:42:35.612671 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.612569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"c3e48f00766b1b22d1dbd0e49681b6d31185bb173c60a1fb2b6eb8d0eaed8aa9"} Jul 07 15:42:35.616220 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:42:35.616550 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"1c626a98919ff75df21d5437b0b029dd829146755a8786e755be3d63a6890da6"} Jul 07 15:42:35.616739 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616717 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:35.616849 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616767 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:35.616849 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616819 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:35.616849 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616866 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:35.617069 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.616996 2556 scope.go:117] "RemoveContainer" containerID="c1a617999a08278c929042cf3f22876e27d4b8577582bf859fd3f5cf033abfaf" Jul 07 15:42:35.617345 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.617323 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m7dsb" Jul 07 15:42:35.632131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.632098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:35.632686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.632670 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:42:35.784785 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:35.784753 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:36.413792 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.413751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:36.415058 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.413798 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:36.415058 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:36.414160 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:36.415058 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:36.414313 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:36.621803 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.621778 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:42:36.622169 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.622143 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" event={"ID":"0b766e02-00ff-4f29-a1cd-08a835c4a99f","Type":"ContainerStarted","Data":"01440feaec99a4f7a9880f2d08382a856b3041229ae10a820a95232241945e58"} Jul 07 15:42:36.655447 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.655403 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" podStartSLOduration=9.293141455 podStartE2EDuration="28.655390466s" totalImagesPullingTime="19.362249011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:36.655350527 +0000 UTC m=+28.808128497" watchObservedRunningTime="2026-07-07 15:42:36.655390466 +0000 UTC m=+28.808168431" Jul 07 15:42:36.907978 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:36.907942 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:37.248084 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.248002 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:37.413986 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.413949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:37.414400 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:37.414072 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:37.527726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.527644 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbvnq"] Jul 07 15:42:37.527915 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.527747 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:37.527915 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:37.527850 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:37.530442 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.530420 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwxxm"] Jul 07 15:42:37.530572 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.530494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:37.530613 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:37.530566 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:37.533683 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.533663 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df9wq"] Jul 07 15:42:37.626638 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.626602 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="ec8c9e2a82073c067e2937544bddd8790c8dea381a3f4027d6f477792ae8b4d6" exitCode=0 Jul 07 15:42:37.626819 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.626692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"ec8c9e2a82073c067e2937544bddd8790c8dea381a3f4027d6f477792ae8b4d6"} Jul 07 15:42:37.626819 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:37.626736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:37.626930 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:37.626824 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:39.223728 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.223498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:39.388369 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.388342 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:39.413453 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.413423 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:39.413611 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.413468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:39.413611 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.413519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:39.413611 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:39.413527 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:39.413611 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:39.413587 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:39.413791 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:39.413692 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:39.632713 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.632676 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="ac3c07f6c70c6701051711e36379155c410b22120d1c30cac27311736c9103b8" exitCode=0 Jul 07 15:42:39.632870 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.632719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"ac3c07f6c70c6701051711e36379155c410b22120d1c30cac27311736c9103b8"} Jul 07 15:42:39.682473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.682439 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:39.777659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:39.777581 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:41.413892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:41.413859 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:41.414554 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:41.413859 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:41.414554 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.413971 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:41.414554 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.414050 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:41.414554 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:41.413863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:41.414554 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.414146 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:41.981735 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:41.981688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:41.981940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:41.981760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:41.981940 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.981854 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:41.981940 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.981878 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:41.981940 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.981940 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret podName:487e2f38-5580-4e12-b413-a483cba73d9d nodeName:}" failed. No retries permitted until 2026-07-07 15:43:13.981920014 +0000 UTC m=+66.134697971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret") pod "global-pull-secret-syncer-vbvnq" (UID: "487e2f38-5580-4e12-b413-a483cba73d9d") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:42:41.982132 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:41.981963 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs podName:b679eb80-e807-42dc-a614-7a49169a655f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:13.981952439 +0000 UTC m=+66.134730387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs") pod "network-metrics-daemon-df9wq" (UID: "b679eb80-e807-42dc-a614-7a49169a655f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:42:42.082506 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:42.082468 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:42.082696 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:42.082672 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:42:42.082752 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:42.082702 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:42:42.082752 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:42.082717 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hvnnn for pod openshift-network-diagnostics/network-check-target-xwxxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:42.082835 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:42.082786 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn podName:92fb5e3d-957d-4197-bdfd-7ccd2ff7193a nodeName:}" failed. No retries permitted until 2026-07-07 15:43:14.082765891 +0000 UTC m=+66.235543837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hvnnn" (UniqueName: "kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn") pod "network-check-target-xwxxm" (UID: "92fb5e3d-957d-4197-bdfd-7ccd2ff7193a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:42:43.413232 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.413162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:43.413232 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.413162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:43.413809 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.413163 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:43.413809 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:43.413326 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbvnq" podUID="487e2f38-5580-4e12-b413-a483cba73d9d" Jul 07 15:42:43.413809 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:43.413411 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xwxxm" podUID="92fb5e3d-957d-4197-bdfd-7ccd2ff7193a" Jul 07 15:42:43.413809 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:43.413478 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df9wq" podUID="b679eb80-e807-42dc-a614-7a49169a655f" Jul 07 15:42:43.654923 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.654859 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-99.ec2.internal" event="NodeReady" Jul 07 15:42:43.655058 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.654987 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 15:42:43.708466 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.708437 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dftgq"] Jul 07 15:42:43.729033 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.729006 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-22x8c"] Jul 07 15:42:43.729171 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.729130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.731469 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.731447 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 15:42:43.731609 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.731580 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 15:42:43.731689 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.731671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr7tb\"" Jul 07 15:42:43.753677 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.753654 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dftgq"] Jul 07 15:42:43.753794 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.753697 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22x8c"] Jul 07 15:42:43.753794 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.753767 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:43.755847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.755827 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 15:42:43.755931 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.755902 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 15:42:43.755982 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.755935 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 15:42:43.755982 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.755944 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pplwf\"" Jul 07 15:42:43.796498 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.796469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.796498 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.796499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f222b7-9025-438d-966c-da9d8c96df65-tmp-dir\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.796691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.796539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38f222b7-9025-438d-966c-da9d8c96df65-config-volume\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.796691 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.796581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz75g\" (UniqueName: \"kubernetes.io/projected/38f222b7-9025-438d-966c-da9d8c96df65-kube-api-access-tz75g\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.897801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.897770 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.897801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.897807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f222b7-9025-438d-966c-da9d8c96df65-tmp-dir\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.897989 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:43.897923 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:43.897989 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.897964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38f222b7-9025-438d-966c-da9d8c96df65-config-volume\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.897989 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:43.897983 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:44.397969766 +0000 UTC m=+36.550747712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:42:43.898103 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.898015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pl6h\" (UniqueName: \"kubernetes.io/projected/e9720587-0373-4cc8-be34-e27ab176c365-kube-api-access-6pl6h\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:43.898103 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.898046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz75g\" (UniqueName: \"kubernetes.io/projected/38f222b7-9025-438d-966c-da9d8c96df65-kube-api-access-tz75g\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.898103 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.898081 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38f222b7-9025-438d-966c-da9d8c96df65-tmp-dir\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.898283 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.898107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9720587-0373-4cc8-be34-e27ab176c365-cert\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:43.898465 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.898448 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38f222b7-9025-438d-966c-da9d8c96df65-config-volume\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.910559 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.910502 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz75g\" (UniqueName: \"kubernetes.io/projected/38f222b7-9025-438d-966c-da9d8c96df65-kube-api-access-tz75g\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:43.916476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.916455 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:43.999229 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.999181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pl6h\" (UniqueName: \"kubernetes.io/projected/e9720587-0373-4cc8-be34-e27ab176c365-kube-api-access-6pl6h\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:43.999401 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:43.999243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9720587-0373-4cc8-be34-e27ab176c365-cert\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:44.010742 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.010719 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pl6h\" (UniqueName: \"kubernetes.io/projected/e9720587-0373-4cc8-be34-e27ab176c365-kube-api-access-6pl6h\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:44.012169 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.012148 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9720587-0373-4cc8-be34-e27ab176c365-cert\") pod \"ingress-canary-22x8c\" (UID: \"e9720587-0373-4cc8-be34-e27ab176c365\") " pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:44.016031 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.015989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:44.061509 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.061477 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22x8c" Jul 07 15:42:44.352606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.352369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22x8c"] Jul 07 15:42:44.357998 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:44.357970 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9720587_0373_4cc8_be34_e27ab176c365.slice/crio-b36bdf4cd92a663d9f0257738e1215f3691b6fd58a6e8df7734d9434d7efda11 WatchSource:0}: Error finding container b36bdf4cd92a663d9f0257738e1215f3691b6fd58a6e8df7734d9434d7efda11: Status 404 returned error can't find the container with id b36bdf4cd92a663d9f0257738e1215f3691b6fd58a6e8df7734d9434d7efda11 Jul 07 15:42:44.401655 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.401625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:44.401772 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:44.401758 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:44.401831 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:44.401822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:45.401803901 +0000 UTC m=+37.554581852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:42:44.648025 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.647996 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="4717ee7f659a653c6ede45fe505f3784660b278803d5021498bb091ef28c79cd" exitCode=0 Jul 07 15:42:44.648519 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.648069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"4717ee7f659a653c6ede45fe505f3784660b278803d5021498bb091ef28c79cd"} Jul 07 15:42:44.649166 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:44.649147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22x8c" event={"ID":"e9720587-0373-4cc8-be34-e27ab176c365","Type":"ContainerStarted","Data":"b36bdf4cd92a663d9f0257738e1215f3691b6fd58a6e8df7734d9434d7efda11"} Jul 07 15:42:45.407779 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.407742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:45.407943 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:45.407856 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:45.407943 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:45.407909 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:47.407895806 +0000 UTC m=+39.560673749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:42:45.413799 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.413779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:42:45.413882 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.413778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:42:45.414012 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.413778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:42:45.417803 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.417784 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88kw6\"" Jul 07 15:42:45.417912 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.417816 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:42:45.418365 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.418352 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:42:45.418546 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.418533 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54b57\"" Jul 07 15:42:45.418629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.418570 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:42:45.418698 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.418573 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:42:45.655446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.655402 2556 generic.go:356] "Generic (PLEG): container finished" podID="8d2c5de2-f62d-4f46-87b1-1f11bc6a318b" containerID="da555e748ff94983355bc42160d7c8dc5d4dbb47002955bc45c0a119a1760d49" exitCode=0 Jul 07 15:42:45.655891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:45.655473 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerDied","Data":"da555e748ff94983355bc42160d7c8dc5d4dbb47002955bc45c0a119a1760d49"} Jul 07 15:42:46.661818 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:46.661584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" event={"ID":"8d2c5de2-f62d-4f46-87b1-1f11bc6a318b","Type":"ContainerStarted","Data":"99dc83c3fb3ca53e49acda258a65b2b83654b59a54b4b48e0e12a26d1a4f4a0c"} Jul 07 15:42:46.687548 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:46.687502 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q6zg5" podStartSLOduration=7.5065357200000005 podStartE2EDuration="38.687483314s" totalImagesPullingTime="31.180947594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:46.686911933 +0000 UTC m=+38.839689902" watchObservedRunningTime="2026-07-07 15:42:46.687483314 +0000 UTC m=+38.840261280" Jul 07 15:42:46.822159 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:46.822119 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:46.888897 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:46.888858 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:47.082929 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:47.082891 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:47.204106 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:47.204024 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:47.424065 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:47.424031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:47.424220 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:47.424168 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:47.424270 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:47.424259 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:51.42423589 +0000 UTC m=+43.577013836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:42:47.665077 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:47.665036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22x8c" event={"ID":"e9720587-0373-4cc8-be34-e27ab176c365","Type":"ContainerStarted","Data":"881331d4a8afa88e6034cf9cb145302cbfdbf5520a39061dd5d50c780231da91"} Jul 07 15:42:47.688312 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:47.688270 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-22x8c" podStartSLOduration=1.730576985 podStartE2EDuration="4.68825413s" totalImagesPullingTime="2.957677145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:47.687560088 +0000 UTC m=+39.840338052" watchObservedRunningTime="2026-07-07 15:42:47.68825413 +0000 UTC m=+39.841032132" Jul 07 15:42:51.452575 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:51.452539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:51.452957 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:51.452684 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:51.452957 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:51.452742 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:59.452728173 +0000 UTC m=+51.605506120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:42:55.806336 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:55.806302 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:55.883446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:55.883385 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:55.957863 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:55.957826 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:56.822347 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.822314 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt"] Jul 07 15:42:56.869008 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.868973 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt"] Jul 07 15:42:56.869154 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.869089 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:56.871778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.871754 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2zj5q\"" Jul 07 15:42:56.871930 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.871755 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:42:56.872629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.872614 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 15:42:56.872677 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.872653 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 15:42:56.872779 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.872759 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 15:42:56.929489 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.929463 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jknpk"] Jul 07 15:42:56.951102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.951076 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj"] Jul 07 15:42:56.951327 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.951270 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:56.953715 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.953696 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 15:42:56.954305 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.954286 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 15:42:56.954878 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.954815 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 15:42:56.954878 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.954842 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vm4b5\"" Jul 07 15:42:56.955074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.954945 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 15:42:56.963830 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.963808 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 15:42:56.965370 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.965351 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj"] Jul 07 15:42:56.965437 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.965382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jknpk"] Jul 07 15:42:56.965476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.965450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:56.968398 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.968370 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 15:42:56.968491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.968463 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 15:42:56.968545 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.968487 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hrsl2\"" Jul 07 15:42:56.968733 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.968710 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:42:56.992436 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.992408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4b8ac0-61ad-4035-b55a-128e5073a246-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:56.992436 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.992436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd4b8ac0-61ad-4035-b55a-128e5073a246-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:56.992621 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:56.992455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhz8\" (UniqueName: \"kubernetes.io/projected/dd4b8ac0-61ad-4035-b55a-128e5073a246-kube-api-access-4zhz8\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.022097 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.022065 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c566b8fdc-9tl98"] Jul 07 15:42:57.048443 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.048413 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c566b8fdc-9tl98"] Jul 07 15:42:57.048584 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.048509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.051357 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 15:42:57.051502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051447 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ks62m\"" Jul 07 15:42:57.051502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051461 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 15:42:57.051502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051475 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 15:42:57.051783 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051767 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 15:42:57.051825 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.051775 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 15:42:57.052109 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.052095 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 15:42:57.093770 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-snapshots\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.093770 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4586k\" (UniqueName: \"kubernetes.io/projected/03c12a1b-429d-4566-a2eb-d15a4d96ee37-kube-api-access-4586k\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4b8ac0-61ad-4035-b55a-128e5073a246-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd4b8ac0-61ad-4035-b55a-128e5073a246-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhz8\" (UniqueName: \"kubernetes.io/projected/dd4b8ac0-61ad-4035-b55a-128e5073a246-kube-api-access-4zhz8\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-tmp\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.093987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.093978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03c12a1b-429d-4566-a2eb-d15a4d96ee37-serving-cert\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.094384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.094001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99nf\" (UniqueName: \"kubernetes.io/projected/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-kube-api-access-k99nf\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.094563 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.094545 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd4b8ac0-61ad-4035-b55a-128e5073a246-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.097720 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.097701 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4b8ac0-61ad-4035-b55a-128e5073a246-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.103835 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.103811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhz8\" (UniqueName: \"kubernetes.io/projected/dd4b8ac0-61ad-4035-b55a-128e5073a246-kube-api-access-4zhz8\") pod \"kube-storage-version-migrator-operator-846bf668f7-cbgxt\" (UID: \"dd4b8ac0-61ad-4035-b55a-128e5073a246\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.178178 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.178143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" Jul 07 15:42:57.194491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194463 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqqd\" (UniqueName: \"kubernetes.io/projected/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-kube-api-access-ppqqd\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.194575 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194501 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-snapshots\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194575 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194554 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4586k\" (UniqueName: \"kubernetes.io/projected/03c12a1b-429d-4566-a2eb-d15a4d96ee37-kube-api-access-4586k\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194575 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194572 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.194693 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194693 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-tmp\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194693 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194693 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194701 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-stats-auth\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03c12a1b-429d-4566-a2eb-d15a4d96ee37-serving-cert\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99nf\" (UniqueName: \"kubernetes.io/projected/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-kube-api-access-k99nf\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.194830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-default-certificate\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.194856 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.194834 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 15:42:57.195132 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.194921 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls podName:ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:57.694897096 +0000 UTC m=+49.847675042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q9mvj" (UID: "ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f") : secret "samples-operator-tls" not found Jul 07 15:42:57.195132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.195102 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-tmp\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.195380 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.195360 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/03c12a1b-429d-4566-a2eb-d15a4d96ee37-snapshots\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.195432 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.195366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.195682 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.195662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c12a1b-429d-4566-a2eb-d15a4d96ee37-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.197158 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.197137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03c12a1b-429d-4566-a2eb-d15a4d96ee37-serving-cert\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.204390 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.204367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4586k\" (UniqueName: \"kubernetes.io/projected/03c12a1b-429d-4566-a2eb-d15a4d96ee37-kube-api-access-4586k\") pod \"insights-operator-5c847dcfc4-jknpk\" (UID: \"03c12a1b-429d-4566-a2eb-d15a4d96ee37\") " pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.204486 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.204464 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99nf\" (UniqueName: \"kubernetes.io/projected/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-kube-api-access-k99nf\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.215696 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.215669 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:57.263394 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.263368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" Jul 07 15:42:57.295826 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.295800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-default-certificate\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.295889 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.295862 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqqd\" (UniqueName: \"kubernetes.io/projected/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-kube-api-access-ppqqd\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.296120 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.296100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.296192 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.296176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.296270 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.296238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-stats-auth\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.296325 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.296294 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:57.79627404 +0000 UTC m=+49.949052004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : configmap references non-existent config key: service-ca.crt Jul 07 15:42:57.296325 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.296295 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 15:42:57.296432 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.296336 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:57.796325664 +0000 UTC m=+49.949103610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : secret "router-metrics-certs-default" not found Jul 07 15:42:57.298601 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.298581 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-stats-auth\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.298713 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.298671 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-default-certificate\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.305191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.305172 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqqd\" (UniqueName: \"kubernetes.io/projected/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-kube-api-access-ppqqd\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.320371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.320344 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt"] Jul 07 15:42:57.320883 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.320847 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:57.324048 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:57.324024 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4b8ac0_61ad_4035_b55a_128e5073a246.slice/crio-2429c4464b9653b905cfe9b26f4f0ca10ff2963a425f81faa512bb4bc71cf42b WatchSource:0}: Error finding container 2429c4464b9653b905cfe9b26f4f0ca10ff2963a425f81faa512bb4bc71cf42b: Status 404 returned error can't find the container with id 2429c4464b9653b905cfe9b26f4f0ca10ff2963a425f81faa512bb4bc71cf42b Jul 07 15:42:57.424423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.424391 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jknpk"] Jul 07 15:42:57.427398 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:42:57.427373 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c12a1b_429d_4566_a2eb_d15a4d96ee37.slice/crio-65d9ee17e3b59acdc926b6209608254403841628212caa2fea8d2a894ba86d4c WatchSource:0}: Error finding container 65d9ee17e3b59acdc926b6209608254403841628212caa2fea8d2a894ba86d4c: Status 404 returned error can't find the container with id 65d9ee17e3b59acdc926b6209608254403841628212caa2fea8d2a894ba86d4c Jul 07 15:42:57.689873 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.689789 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" event={"ID":"03c12a1b-429d-4566-a2eb-d15a4d96ee37","Type":"ContainerStarted","Data":"65d9ee17e3b59acdc926b6209608254403841628212caa2fea8d2a894ba86d4c"} Jul 07 15:42:57.690924 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.690902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" event={"ID":"dd4b8ac0-61ad-4035-b55a-128e5073a246","Type":"ContainerStarted","Data":"2429c4464b9653b905cfe9b26f4f0ca10ff2963a425f81faa512bb4bc71cf42b"} Jul 07 15:42:57.699257 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.699237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:57.699366 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.699354 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 15:42:57.699414 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.699406 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls podName:ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:58.699392769 +0000 UTC m=+50.852170713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q9mvj" (UID: "ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f") : secret "samples-operator-tls" not found Jul 07 15:42:57.799797 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.799763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.799915 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:57.799894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:57.799952 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.799919 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 15:42:57.800000 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.799987 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:58.799969456 +0000 UTC m=+50.952747409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : secret "router-metrics-certs-default" not found Jul 07 15:42:57.800042 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:57.800009 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:42:58.799998938 +0000 UTC m=+50.952776882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : configmap references non-existent config key: service-ca.crt Jul 07 15:42:58.712120 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:58.711998 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:42:58.712120 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:58.712120 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 15:42:58.712658 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:58.712194 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls podName:ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:00.712174165 +0000 UTC m=+52.864952122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q9mvj" (UID: "ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f") : secret "samples-operator-tls" not found Jul 07 15:42:58.812743 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:58.812703 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:58.812939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:58.812777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:42:58.813005 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:58.812972 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 15:42:58.813052 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:58.813007 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:00.812983486 +0000 UTC m=+52.965761437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : configmap references non-existent config key: service-ca.crt Jul 07 15:42:58.813052 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:58.813038 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:00.813026917 +0000 UTC m=+52.965804860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : secret "router-metrics-certs-default" not found Jul 07 15:42:59.146110 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:59.146070 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:42:59.520934 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:42:59.520852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:42:59.521104 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:59.520987 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 15:42:59.521104 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:42:59.521077 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls podName:38f222b7-9025-438d-966c-da9d8c96df65 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:15.521046531 +0000 UTC m=+67.673824483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls") pod "dns-default-dftgq" (UID: "38f222b7-9025-438d-966c-da9d8c96df65") : secret "dns-default-metrics-tls" not found Jul 07 15:43:00.068976 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.068937 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:00.138072 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.138032 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:00.210930 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.210896 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:00.733230 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.733182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:43:00.733493 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:00.733301 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 15:43:00.733493 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:00.733352 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls podName:ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.733338967 +0000 UTC m=+56.886116910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q9mvj" (UID: "ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f") : secret "samples-operator-tls" not found Jul 07 15:43:00.834314 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.834281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:00.834502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:00.834337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:00.834502 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:00.834484 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.834463359 +0000 UTC m=+56.987241303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : configmap references non-existent config key: service-ca.crt Jul 07 15:43:00.834502 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:00.834483 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 15:43:00.834637 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:00.834533 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.834523457 +0000 UTC m=+56.987301429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : secret "router-metrics-certs-default" not found Jul 07 15:43:01.209083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.209049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:01.452185 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.452143 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:01.654235 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.654186 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:01.703348 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.703247 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" event={"ID":"03c12a1b-429d-4566-a2eb-d15a4d96ee37","Type":"ContainerStarted","Data":"b53b2ca81993eb2b4496de3c199603a55f08dd1c83365d79640519436f05faf6"} Jul 07 15:43:01.704719 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.704685 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" event={"ID":"dd4b8ac0-61ad-4035-b55a-128e5073a246","Type":"ContainerStarted","Data":"f78302e7dc5b6fee682905d730c0c507fead6273accc6aa871ca10b53b7766f5"} Jul 07 15:43:01.732629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.732576 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" podStartSLOduration=2.124212564 podStartE2EDuration="5.732560117s" totalImagesPullingTime="3.608347553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:01.731991699 +0000 UTC m=+53.884769665" watchObservedRunningTime="2026-07-07 15:43:01.732560117 +0000 UTC m=+53.885338095" Jul 07 15:43:01.752858 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.752804 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:01.776272 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.776196 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" podStartSLOduration=2.068177724 podStartE2EDuration="5.776172408s" totalImagesPullingTime="3.707994684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:01.775079435 +0000 UTC m=+53.927857406" watchObservedRunningTime="2026-07-07 15:43:01.776172408 +0000 UTC m=+53.928950374" Jul 07 15:43:01.954723 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:01.954636 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:02.035374 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:02.035339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:02.346446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:02.346412 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:02.446506 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:02.446468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:03.287681 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.287646 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qcrvn"] Jul 07 15:43:03.311997 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.311963 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcrvn"] Jul 07 15:43:03.312179 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.312084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.315223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.315186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 15:43:03.315368 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.315186 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 15:43:03.315829 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.315794 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68vpx\"" Jul 07 15:43:03.334902 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.334877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:03.428875 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.428840 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:03.458070 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.458031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8btw2\" (UniqueName: \"kubernetes.io/projected/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-api-access-8btw2\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.458292 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.458156 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.458292 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.458191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0baa3194-0cdd-4199-8cea-fe844cba9f43-crio-socket\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.458292 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.458267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.458456 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.458348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0baa3194-0cdd-4199-8cea-fe844cba9f43-data-volume\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.539454 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.539370 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:03.558754 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.558885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0baa3194-0cdd-4199-8cea-fe844cba9f43-data-volume\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.558885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558803 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8btw2\" (UniqueName: \"kubernetes.io/projected/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-api-access-8btw2\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.558885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.558885 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:03.558861 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:43:03.559039 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0baa3194-0cdd-4199-8cea-fe844cba9f43-crio-socket\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.559039 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.558866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0baa3194-0cdd-4199-8cea-fe844cba9f43-crio-socket\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.559039 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:03.558935 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.058913148 +0000 UTC m=+56.211691091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : secret "insights-runtime-extractor-tls" not found Jul 07 15:43:03.559039 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:03.558964 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:43:03.559039 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:03.559011 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.058995345 +0000 UTC m=+56.211773288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : configmap "kube-rbac-proxy" not found Jul 07 15:43:03.559279 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.559243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0baa3194-0cdd-4199-8cea-fe844cba9f43-data-volume\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.578730 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.578704 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8btw2\" (UniqueName: \"kubernetes.io/projected/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-api-access-8btw2\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:03.666916 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.666879 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:03.745125 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:03.745089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:04.062391 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.062352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:04.062595 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.062418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:04.062595 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.062481 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:43:04.062595 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.062557 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:05.062541356 +0000 UTC m=+57.215319300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : configmap "kube-rbac-proxy" not found Jul 07 15:43:04.062595 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.062589 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:43:04.062782 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.062668 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:05.062649134 +0000 UTC m=+57.215427081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : secret "insights-runtime-extractor-tls" not found Jul 07 15:43:04.471417 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.471345 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:04.768309 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.768197 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:43:04.768459 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.768376 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 15:43:04.768459 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.768445 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls podName:ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:12.768427838 +0000 UTC m=+64.921205781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-q9mvj" (UID: "ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f") : secret "samples-operator-tls" not found Jul 07 15:43:04.869521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.869484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:04.869711 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:04.869553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:04.869711 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.869630 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 15:43:04.869711 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.869693 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:12.86967899 +0000 UTC m=+65.022456936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : secret "router-metrics-certs-default" not found Jul 07 15:43:04.869826 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:04.869715 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle podName:9aff63dd-13e8-4627-b62f-ada8a4b0fe2f nodeName:}" failed. No retries permitted until 2026-07-07 15:43:12.86970196 +0000 UTC m=+65.022479906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle") pod "router-default-6c566b8fdc-9tl98" (UID: "9aff63dd-13e8-4627-b62f-ada8a4b0fe2f") : configmap references non-existent config key: service-ca.crt Jul 07 15:43:05.071164 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.071128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:05.071359 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.071188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:05.071359 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:05.071274 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:43:05.071359 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:05.071290 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:43:05.071359 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:05.071347 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:07.071328322 +0000 UTC m=+59.224106265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : configmap "kube-rbac-proxy" not found Jul 07 15:43:05.071512 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:05.071373 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:07.071362547 +0000 UTC m=+59.224140490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : secret "insights-runtime-extractor-tls" not found Jul 07 15:43:05.264953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.264929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w6b4s_cfd7b670-a8ee-43c6-9d3a-eca3d6583735/dns-node-resolver/0.log" Jul 07 15:43:05.411013 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.410941 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:05.610718 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.610683 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:05.713961 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.713875 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:05.843461 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.843430 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:05.963440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:05.963405 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:06.059449 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:06.059419 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:06.148850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:06.148817 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:06.467405 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:06.467329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzbf2_b8bb7b0d-83b3-4093-8134-aed3728db1b9/node-ca/0.log" Jul 07 15:43:06.864669 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:06.864630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-22x8c_e9720587-0373-4cc8-be34-e27ab176c365/serve-healthcheck-canary/0.log" Jul 07 15:43:06.922177 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:06.922148 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:07.088282 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:07.088246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:07.088486 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:07.088312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:07.088486 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:07.088378 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:43:07.088486 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:07.088428 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:43:07.088486 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:07.088457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:11.088436812 +0000 UTC m=+63.241214760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : configmap "kube-rbac-proxy" not found Jul 07 15:43:07.088486 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:07.088477 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:11.08846775 +0000 UTC m=+63.241245701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : secret "insights-runtime-extractor-tls" not found Jul 07 15:43:07.306079 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:07.306054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:07.637355 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:07.637285 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-brcfh" Jul 07 15:43:07.720127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:07.720094 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:08.103136 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:08.103102 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:08.317770 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:08.317736 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:08.712125 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:08.712088 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:09.113091 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:09.113064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:09.258761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:09.258733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:09.357344 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:09.357317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:09.504235 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:09.504144 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:10.122708 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:10.122673 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:10.186651 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:10.186617 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:10.504697 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:10.504611 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:10.710336 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:10.710308 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:11.107623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:11.107593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:11.118858 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:11.118815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:11.118982 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:11.118960 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 15:43:11.119048 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:11.119036 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:19.119017889 +0000 UTC m=+71.271795835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : secret "insights-runtime-extractor-tls" not found Jul 07 15:43:11.119104 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:11.119083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:11.119191 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:11.119180 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 15:43:11.119251 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:43:11.119242 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm podName:0baa3194-0cdd-4199-8cea-fe844cba9f43 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:19.119233262 +0000 UTC m=+71.272011206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qcrvn" (UID: "0baa3194-0cdd-4199-8cea-fe844cba9f43") : configmap "kube-rbac-proxy" not found Jul 07 15:43:11.557955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:11.557922 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:11.911777 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:11.911689 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.308974 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.308938 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.527895 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.527859 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.711891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.711810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.834003 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.833971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:43:12.836371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.836348 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-q9mvj\" (UID: \"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:43:12.876997 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.876971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hrsl2\"" Jul 07 15:43:12.885033 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.885002 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" Jul 07 15:43:12.923333 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.923292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:12.935371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.935340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:12.935509 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.935430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:12.936135 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.936110 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-service-ca-bundle\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:12.937722 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.937702 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aff63dd-13e8-4627-b62f-ada8a4b0fe2f-metrics-certs\") pod \"router-default-6c566b8fdc-9tl98\" (UID: \"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f\") " pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:12.959954 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.959926 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ks62m\"" Jul 07 15:43:12.968496 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:12.968445 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:13.014284 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.014245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj"] Jul 07 15:43:13.136077 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.136053 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c566b8fdc-9tl98"] Jul 07 15:43:13.137600 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:13.137579 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aff63dd_13e8_4627_b62f_ada8a4b0fe2f.slice/crio-5d63a4f8dafca79e96b1e598b5ead5bb1e0f0964a774dc9aaaf2002e0e0aa760 WatchSource:0}: Error finding container 5d63a4f8dafca79e96b1e598b5ead5bb1e0f0964a774dc9aaaf2002e0e0aa760: Status 404 returned error can't find the container with id 5d63a4f8dafca79e96b1e598b5ead5bb1e0f0964a774dc9aaaf2002e0e0aa760 Jul 07 15:43:13.734956 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.734855 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" event={"ID":"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f","Type":"ContainerStarted","Data":"601e6e2f2e6d4c8e79eb12978f79999c16b8132bf50a605e428d1614fb1f699b"} Jul 07 15:43:13.736466 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.736440 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" event={"ID":"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f","Type":"ContainerStarted","Data":"d96b4af2a5f074bf3c195cd1965eadb86aedce47442ed378c581fc54587515a6"} Jul 07 15:43:13.736605 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.736485 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" event={"ID":"9aff63dd-13e8-4627-b62f-ada8a4b0fe2f","Type":"ContainerStarted","Data":"5d63a4f8dafca79e96b1e598b5ead5bb1e0f0964a774dc9aaaf2002e0e0aa760"} Jul 07 15:43:13.759307 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.759241 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" podStartSLOduration=16.759199427 podStartE2EDuration="16.759199427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:13.758549598 +0000 UTC m=+65.911327564" watchObservedRunningTime="2026-07-07 15:43:13.759199427 +0000 UTC m=+65.911977395" Jul 07 15:43:13.968925 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.968893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:13.971761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:13.971735 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:14.045871 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.045784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:43:14.045871 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.045832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:43:14.048254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.048237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:43:14.048303 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.048237 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:43:14.058385 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.058352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/487e2f38-5580-4e12-b413-a483cba73d9d-original-pull-secret\") pod \"global-pull-secret-syncer-vbvnq\" (UID: \"487e2f38-5580-4e12-b413-a483cba73d9d\") " pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:43:14.058520 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.058383 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b679eb80-e807-42dc-a614-7a49169a655f-metrics-certs\") pod \"network-metrics-daemon-df9wq\" (UID: \"b679eb80-e807-42dc-a614-7a49169a655f\") " pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:43:14.103961 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.103929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.146750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.146716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:43:14.149504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.149476 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:43:14.159674 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.159646 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:43:14.170770 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.170745 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvnnn\" (UniqueName: \"kubernetes.io/projected/92fb5e3d-957d-4197-bdfd-7ccd2ff7193a-kube-api-access-hvnnn\") pod \"network-check-target-xwxxm\" (UID: \"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a\") " pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:43:14.225863 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.225830 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88kw6\"" Jul 07 15:43:14.228515 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.228496 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbvnq" Jul 07 15:43:14.233780 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.233757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df9wq" Jul 07 15:43:14.236126 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.236111 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54b57\"" Jul 07 15:43:14.244079 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.244059 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:43:14.309246 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.309177 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.384172 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.384100 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbvnq"] Jul 07 15:43:14.386870 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:14.386844 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487e2f38_5580_4e12_b413_a483cba73d9d.slice/crio-14b1ed25a65ef1c3d689900a8347471f33e65006dd6bbdbe1a81de49d6da145e WatchSource:0}: Error finding container 14b1ed25a65ef1c3d689900a8347471f33e65006dd6bbdbe1a81de49d6da145e: Status 404 returned error can't find the container with id 14b1ed25a65ef1c3d689900a8347471f33e65006dd6bbdbe1a81de49d6da145e Jul 07 15:43:14.408829 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.408799 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df9wq"] Jul 07 15:43:14.411868 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:14.411846 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb679eb80_e807_42dc_a614_7a49169a655f.slice/crio-2ed8badc2713c594ef93e380e994f711d9cf0bb3f8cf52e1f8cb4656a78fde16 WatchSource:0}: Error finding container 2ed8badc2713c594ef93e380e994f711d9cf0bb3f8cf52e1f8cb4656a78fde16: Status 404 returned error can't find the container with id 2ed8badc2713c594ef93e380e994f711d9cf0bb3f8cf52e1f8cb4656a78fde16 Jul 07 15:43:14.418481 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.418459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xwxxm"] Jul 07 15:43:14.420846 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:14.420823 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fb5e3d_957d_4197_bdfd_7ccd2ff7193a.slice/crio-3558bf703db84b38a49193a899b42e8caa2111fb4ab4469a4e377ae5660f5c8b WatchSource:0}: Error finding container 3558bf703db84b38a49193a899b42e8caa2111fb4ab4469a4e377ae5660f5c8b: Status 404 returned error can't find the container with id 3558bf703db84b38a49193a899b42e8caa2111fb4ab4469a4e377ae5660f5c8b Jul 07 15:43:14.508004 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.507965 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.703631 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.703550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.740437 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.740405 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwxxm" event={"ID":"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a","Type":"ContainerStarted","Data":"3558bf703db84b38a49193a899b42e8caa2111fb4ab4469a4e377ae5660f5c8b"} Jul 07 15:43:14.741795 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.741767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df9wq" event={"ID":"b679eb80-e807-42dc-a614-7a49169a655f","Type":"ContainerStarted","Data":"2ed8badc2713c594ef93e380e994f711d9cf0bb3f8cf52e1f8cb4656a78fde16"} Jul 07 15:43:14.743084 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.743061 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vbvnq" event={"ID":"487e2f38-5580-4e12-b413-a483cba73d9d","Type":"ContainerStarted","Data":"14b1ed25a65ef1c3d689900a8347471f33e65006dd6bbdbe1a81de49d6da145e"} Jul 07 15:43:14.743423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.743399 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:14.744711 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.744690 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c566b8fdc-9tl98" Jul 07 15:43:14.842753 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.842724 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:14.943331 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:14.943246 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.364394 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.364317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.464228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.464186 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.560336 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.560296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:43:15.571544 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.571477 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38f222b7-9025-438d-966c-da9d8c96df65-metrics-tls\") pod \"dns-default-dftgq\" (UID: \"38f222b7-9025-438d-966c-da9d8c96df65\") " pod="openshift-dns/dns-default-dftgq" Jul 07 15:43:15.571942 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.571884 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.644361 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.644247 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.711479 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.711448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:15.750629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.750584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" event={"ID":"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f","Type":"ContainerStarted","Data":"52f5aef17f696a6fa8c71ab1891190ba6ee9dfb8eb0eec58d2b5be1009c85cb4"} Jul 07 15:43:15.751054 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.750640 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" event={"ID":"ad4a5a9b-6ecd-4c47-a2a4-aee260354d1f","Type":"ContainerStarted","Data":"ee9c98857983c0f6585e99978175ab0a97744cc1b9332b1cb3a39f0dd25433ba"} Jul 07 15:43:15.773139 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.773096 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-q9mvj" podStartSLOduration=17.832641189 podStartE2EDuration="19.773075711s" totalImagesPullingTime="1.940434522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:15.771833728 +0000 UTC m=+67.924611693" watchObservedRunningTime="2026-07-07 15:43:15.773075711 +0000 UTC m=+67.925853676" Jul 07 15:43:15.844448 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.844422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr7tb\"" Jul 07 15:43:15.852502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.852474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dftgq" Jul 07 15:43:15.901492 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:15.901383 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:16.010300 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.010166 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dftgq"] Jul 07 15:43:16.014029 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:16.013990 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f222b7_9025_438d_966c_da9d8c96df65.slice/crio-b213210b6917e088b2dc4875fd30da08f28484a5342343c2aa693b2baf636d0f WatchSource:0}: Error finding container b213210b6917e088b2dc4875fd30da08f28484a5342343c2aa693b2baf636d0f: Status 404 returned error can't find the container with id b213210b6917e088b2dc4875fd30da08f28484a5342343c2aa693b2baf636d0f Jul 07 15:43:16.076858 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.076811 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:16.143402 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.143368 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:16.505835 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.505801 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:16.758255 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.757873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df9wq" event={"ID":"b679eb80-e807-42dc-a614-7a49169a655f","Type":"ContainerStarted","Data":"a8a0c4c33629c60240929b74646c33153de4218d4d8d476aba30ece555c22d85"} Jul 07 15:43:16.758255 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.757931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df9wq" event={"ID":"b679eb80-e807-42dc-a614-7a49169a655f","Type":"ContainerStarted","Data":"aa64dba5968910f51657c93699b5047be84590be964ed464fc665e4fd2180b0d"} Jul 07 15:43:16.759922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.759892 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dftgq" event={"ID":"38f222b7-9025-438d-966c-da9d8c96df65","Type":"ContainerStarted","Data":"b213210b6917e088b2dc4875fd30da08f28484a5342343c2aa693b2baf636d0f"} Jul 07 15:43:16.778568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:16.778505 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-df9wq" podStartSLOduration=67.436471375 podStartE2EDuration="1m8.77848118s" totalImagesPullingTime="1.342009805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:16.7779834 +0000 UTC m=+68.930761366" watchObservedRunningTime="2026-07-07 15:43:16.77848118 +0000 UTC m=+68.931259146" Jul 07 15:43:18.029603 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:18.029564 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:18.102146 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:18.102113 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:19.192295 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.192248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:19.192747 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.192329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:19.192892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.192866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0baa3194-0cdd-4199-8cea-fe844cba9f43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:19.195008 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.194980 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0baa3194-0cdd-4199-8cea-fe844cba9f43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qcrvn\" (UID: \"0baa3194-0cdd-4199-8cea-fe844cba9f43\") " pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:19.224403 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.224374 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68vpx\"" Jul 07 15:43:19.232089 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:19.232054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qcrvn" Jul 07 15:43:20.108789 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.108755 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:20.212527 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.212493 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:20.398067 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.397973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:20.508430 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.508384 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qcrvn"] Jul 07 15:43:20.513367 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:20.513327 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0baa3194_0cdd_4199_8cea_fe844cba9f43.slice/crio-a85327d16fcb72e0a7e650fb8d2a3728da019252d04f49c76fe579e65aff74f6 WatchSource:0}: Error finding container a85327d16fcb72e0a7e650fb8d2a3728da019252d04f49c76fe579e65aff74f6: Status 404 returned error can't find the container with id a85327d16fcb72e0a7e650fb8d2a3728da019252d04f49c76fe579e65aff74f6 Jul 07 15:43:20.594768 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.594740 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:20.775655 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.775564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcrvn" event={"ID":"0baa3194-0cdd-4199-8cea-fe844cba9f43","Type":"ContainerStarted","Data":"a85327d16fcb72e0a7e650fb8d2a3728da019252d04f49c76fe579e65aff74f6"} Jul 07 15:43:20.776933 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.776909 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vbvnq" event={"ID":"487e2f38-5580-4e12-b413-a483cba73d9d","Type":"ContainerStarted","Data":"a42fffa2d04fe6a9419586c8b4a17f59f6207cf6c22ce3c4626b8e02450a7334"} Jul 07 15:43:20.778674 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.778653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dftgq" event={"ID":"38f222b7-9025-438d-966c-da9d8c96df65","Type":"ContainerStarted","Data":"916abbed38640c9b7ddf8d4dafad9e822508819cc64561a1e0891f7a65023911"} Jul 07 15:43:20.778760 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.778689 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dftgq" event={"ID":"38f222b7-9025-438d-966c-da9d8c96df65","Type":"ContainerStarted","Data":"1a1b032fa59e6134244f43c6d1f0ff384bd7df3c9bfe65b110e09ef73a5b858a"} Jul 07 15:43:20.778760 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.778709 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dftgq" Jul 07 15:43:20.780026 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.780005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xwxxm" event={"ID":"92fb5e3d-957d-4197-bdfd-7ccd2ff7193a","Type":"ContainerStarted","Data":"2068605b3fe49dc6d14b8f46e69e218f65e6fe9043e5a6477bd79cceea430fd2"} Jul 07 15:43:20.780153 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.780138 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:43:20.795748 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.795727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:20.799845 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.799800 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vbvnq" podStartSLOduration=66.817556879 podStartE2EDuration="1m12.799785491s" totalImagesPullingTime="5.982228612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:20.799018915 +0000 UTC m=+72.951796888" watchObservedRunningTime="2026-07-07 15:43:20.799785491 +0000 UTC m=+72.952563435" Jul 07 15:43:20.822875 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.822830 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dftgq" podStartSLOduration=33.477030212 podStartE2EDuration="37.822812026s" totalImagesPullingTime="4.345781814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:20.822533447 +0000 UTC m=+72.975311437" watchObservedRunningTime="2026-07-07 15:43:20.822812026 +0000 UTC m=+72.975589996" Jul 07 15:43:20.850827 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.850779 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xwxxm" podStartSLOduration=66.91738117 podStartE2EDuration="1m12.850760953s" totalImagesPullingTime="5.933379783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:20.850051373 +0000 UTC m=+73.002829338" watchObservedRunningTime="2026-07-07 15:43:20.850760953 +0000 UTC m=+73.003538917" Jul 07 15:43:20.881768 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:20.881731 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:21.172993 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:21.172904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:21.247869 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:21.247790 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:21.805337 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:21.805311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:21.905185 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:21.905149 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:22.015572 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:22.015537 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:22.831522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:22.831491 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:22.913625 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:22.913583 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:24.799087 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.799031 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcrvn" event={"ID":"0baa3194-0cdd-4199-8cea-fe844cba9f43","Type":"ContainerStarted","Data":"7d154be8f6ce890aecd5d62d95ec476327bc695e7f90e63251dc06c580c22f15"} Jul 07 15:43:24.829341 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.829320 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw"] Jul 07 15:43:24.831175 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.831162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:24.833575 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.833555 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 15:43:24.834093 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.834073 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 15:43:24.834410 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.834394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x92vx\"" Jul 07 15:43:24.843933 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.843912 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94"] Jul 07 15:43:24.846427 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.846407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.850362 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.850339 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 15:43:24.850362 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.850361 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 07 15:43:24.855260 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.855089 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 07 15:43:24.855260 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.855108 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 07 15:43:24.855260 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.855089 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 15:43:24.855260 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.855224 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 07 15:43:24.855260 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.855230 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 15:43:24.856845 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.856823 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw"] Jul 07 15:43:24.870437 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.869090 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94"] Jul 07 15:43:24.886791 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.886765 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69d9f686fb-dfqms"] Jul 07 15:43:24.888900 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.888882 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.892513 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.892491 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d8w2m\"" Jul 07 15:43:24.894164 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.894144 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 15:43:24.909435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.909415 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 15:43:24.909546 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.909518 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 15:43:24.910891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.910870 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d9f686fb-dfqms"] Jul 07 15:43:24.913546 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.913529 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 15:43:24.933849 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.933829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/653d4bda-89b9-4731-b8ed-534f44d76477-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:24.933967 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.933858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-tls\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.933967 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.933881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-trusted-ca\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.933967 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.933908 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmlbb\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-kube-api-access-vmlbb\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.934127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-image-registry-private-configuration\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.934127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-certificates\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-bound-sa-token\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/653d4bda-89b9-4731-b8ed-534f44d76477-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f758\" (UniqueName: \"kubernetes.io/projected/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-kube-api-access-4f758\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559cbf36-707a-4c15-b45a-f25eb50abe9a-ca-trust-extracted\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:24.934381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.934376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-installation-pull-secrets\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:24.967168 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:24.967133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:25.034996 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.034965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-installation-pull-secrets\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.034996 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.034999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/653d4bda-89b9-4731-b8ed-534f44d76477-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035023 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-tls\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-trusted-ca\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmlbb\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-kube-api-access-vmlbb\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-image-registry-private-configuration\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-certificates\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.035266 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.035198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-bound-sa-token\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/653d4bda-89b9-4731-b8ed-534f44d76477-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036115 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f758\" (UniqueName: \"kubernetes.io/projected/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-kube-api-access-4f758\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036150 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559cbf36-707a-4c15-b45a-f25eb50abe9a-ca-trust-extracted\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036191 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-trusted-ca\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.036582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.036568 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-certificates\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.037600 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.037183 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/653d4bda-89b9-4731-b8ed-534f44d76477-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:25.037600 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.037304 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.037600 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.037549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/559cbf36-707a-4c15-b45a-f25eb50abe9a-ca-trust-extracted\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.038221 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.038161 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.038389 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.038369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-registry-tls\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.038533 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.038518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-image-registry-private-configuration\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.038871 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.038852 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.039284 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.039268 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/653d4bda-89b9-4731-b8ed-534f44d76477-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-2ckmw\" (UID: \"653d4bda-89b9-4731-b8ed-534f44d76477\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:25.039893 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.039867 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.039993 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.039943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-ca\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.039993 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.039949 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/559cbf36-707a-4c15-b45a-f25eb50abe9a-installation-pull-secrets\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.052221 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.052159 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f758\" (UniqueName: \"kubernetes.io/projected/e34efc2f-ecd2-49a7-b0b6-19e170d14c8c-kube-api-access-4f758\") pod \"cluster-proxy-proxy-agent-577dbbddd6-lgl94\" (UID: \"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.054701 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.054682 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-bound-sa-token\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.054829 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.054808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmlbb\" (UniqueName: \"kubernetes.io/projected/559cbf36-707a-4c15-b45a-f25eb50abe9a-kube-api-access-vmlbb\") pod \"image-registry-69d9f686fb-dfqms\" (UID: \"559cbf36-707a-4c15-b45a-f25eb50abe9a\") " pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.091980 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.091956 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:25.140265 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.140230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" Jul 07 15:43:25.182237 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.182196 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" Jul 07 15:43:25.196154 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.196031 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:25.200686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.200587 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.274345 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.274276 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw"] Jul 07 15:43:25.280332 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:25.280237 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653d4bda_89b9_4731_b8ed_534f44d76477.slice/crio-4c0bfa11a9f8c77328c3a8430a074bf430e66651d9d5568830684e63c9ef9409 WatchSource:0}: Error finding container 4c0bfa11a9f8c77328c3a8430a074bf430e66651d9d5568830684e63c9ef9409: Status 404 returned error can't find the container with id 4c0bfa11a9f8c77328c3a8430a074bf430e66651d9d5568830684e63c9ef9409 Jul 07 15:43:25.295112 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.295045 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:25.345612 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.345539 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94"] Jul 07 15:43:25.349050 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:25.349019 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode34efc2f_ecd2_49a7_b0b6_19e170d14c8c.slice/crio-a3db7210b8cff7344718ee56139b3ce973b28a261691abbe539486ce39ab1127 WatchSource:0}: Error finding container a3db7210b8cff7344718ee56139b3ce973b28a261691abbe539486ce39ab1127: Status 404 returned error can't find the container with id a3db7210b8cff7344718ee56139b3ce973b28a261691abbe539486ce39ab1127 Jul 07 15:43:25.370951 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.370927 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d9f686fb-dfqms"] Jul 07 15:43:25.373680 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:25.373655 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559cbf36_707a_4c15_b45a_f25eb50abe9a.slice/crio-bcb20a2ccce9c51baaad535ad880f547727702805c0b8800f01932479b22b4a8 WatchSource:0}: Error finding container bcb20a2ccce9c51baaad535ad880f547727702805c0b8800f01932479b22b4a8: Status 404 returned error can't find the container with id bcb20a2ccce9c51baaad535ad880f547727702805c0b8800f01932479b22b4a8 Jul 07 15:43:25.804536 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.804459 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcrvn" event={"ID":"0baa3194-0cdd-4199-8cea-fe844cba9f43","Type":"ContainerStarted","Data":"85d4394daf7056dd53e0e26ce191422b3bfc88e3eeb05e0ea53a078dc9ba7297"} Jul 07 15:43:25.805947 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.805920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" event={"ID":"653d4bda-89b9-4731-b8ed-534f44d76477","Type":"ContainerStarted","Data":"4c0bfa11a9f8c77328c3a8430a074bf430e66651d9d5568830684e63c9ef9409"} Jul 07 15:43:25.807660 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.807636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" event={"ID":"559cbf36-707a-4c15-b45a-f25eb50abe9a","Type":"ContainerStarted","Data":"f1bd1e093aee07e182e6193cf3b791850b8e183ccbe58e370ffa630cd2fcea74"} Jul 07 15:43:25.807758 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.807679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" event={"ID":"559cbf36-707a-4c15-b45a-f25eb50abe9a","Type":"ContainerStarted","Data":"bcb20a2ccce9c51baaad535ad880f547727702805c0b8800f01932479b22b4a8"} Jul 07 15:43:25.807758 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.807706 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:25.809412 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.809380 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" event={"ID":"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c","Type":"ContainerStarted","Data":"a3db7210b8cff7344718ee56139b3ce973b28a261691abbe539486ce39ab1127"} Jul 07 15:43:25.831105 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:25.831051 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" podStartSLOduration=1.831030798 podStartE2EDuration="1.831030798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:25.829113128 +0000 UTC m=+77.981891093" watchObservedRunningTime="2026-07-07 15:43:25.831030798 +0000 UTC m=+77.983808761" Jul 07 15:43:29.632349 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.632191 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:29.738117 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.738083 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:29.828274 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.827787 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qcrvn" event={"ID":"0baa3194-0cdd-4199-8cea-fe844cba9f43","Type":"ContainerStarted","Data":"8cf874f5c3d691ba2517d22b1bc5ae55082adab9236939c6e756f886d7fc99ee"} Jul 07 15:43:29.829607 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.829578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" event={"ID":"653d4bda-89b9-4731-b8ed-534f44d76477","Type":"ContainerStarted","Data":"2efc97d7598e7c57e9f07f541129dc2697a4d66de04876f4aaed76e093e86cb9"} Jul 07 15:43:29.832185 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.832155 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" event={"ID":"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c","Type":"ContainerStarted","Data":"b668a409dbfc45d4fea3d90c4d7d0b54d1d1e5115bda7b19719eaee9ed05aad9"} Jul 07 15:43:29.851988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.851940 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qcrvn" podStartSLOduration=17.776534406 podStartE2EDuration="26.851923704s" totalImagesPullingTime="9.075389298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:43:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:29.851288816 +0000 UTC m=+82.004066781" watchObservedRunningTime="2026-07-07 15:43:29.851923704 +0000 UTC m=+82.004701669" Jul 07 15:43:29.882967 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:29.882888 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-2ckmw" podStartSLOduration=1.445540895 podStartE2EDuration="5.882869005s" totalImagesPullingTime="4.43732811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:29.881142973 +0000 UTC m=+82.033920938" watchObservedRunningTime="2026-07-07 15:43:29.882869005 +0000 UTC m=+82.035646969" Jul 07 15:43:30.052659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.052626 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:30.166172 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.166089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:30.285081 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.285051 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:30.787230 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.787183 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dftgq" Jul 07 15:43:30.838382 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.838335 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" event={"ID":"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c","Type":"ContainerStarted","Data":"7d35278c90d2196c167242c1d2fd54222657ce3f8ef561a41e0eb3c5494f17b0"} Jul 07 15:43:30.838382 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.838388 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" event={"ID":"e34efc2f-ecd2-49a7-b0b6-19e170d14c8c","Type":"ContainerStarted","Data":"c5572d84f402b3645237577a3dc8437e8becf497d911baa6805e09feca88f6eb"} Jul 07 15:43:30.865480 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:30.865427 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-577dbbddd6-lgl94" podStartSLOduration=2.451891424 podStartE2EDuration="6.865408763s" totalImagesPullingTime="4.413517339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:30.865008458 +0000 UTC m=+83.017786448" watchObservedRunningTime="2026-07-07 15:43:30.865408763 +0000 UTC m=+83.018186729" Jul 07 15:43:32.081368 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:32.081336 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:33.654163 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:33.654119 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:33.731936 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:33.731898 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:34.787225 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:34.787173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:34.985731 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:34.985693 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.087646 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.087612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.167922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.167888 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zbcw2"] Jul 07 15:43:35.171156 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.171129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.173845 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.173821 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 15:43:35.174077 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.174061 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 15:43:35.174131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.174110 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 15:43:35.174992 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.174976 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 15:43:35.175073 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.175034 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56vcq\"" Jul 07 15:43:35.175392 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.175376 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 15:43:35.175941 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.175920 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 15:43:35.187264 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.187233 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.222026 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.221993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222026 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222239 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-root\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222239 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxskf\" (UniqueName: \"kubernetes.io/projected/31436b55-2f8f-41f2-b299-509002fdfa78-kube-api-access-qxskf\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222313 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-wtmp\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222313 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-metrics-client-ca\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222313 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-tls\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222401 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-sys\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.222401 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.222352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-textfile\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.284163 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.284122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.322779 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322734 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-sys\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.322779 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-textfile\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-sys\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-root\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.322986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxskf\" (UniqueName: \"kubernetes.io/projected/31436b55-2f8f-41f2-b299-509002fdfa78-kube-api-access-qxskf\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-wtmp\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323038 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-root\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-metrics-client-ca\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-tls\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323186 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-textfile\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323267 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-wtmp\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-metrics-client-ca\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.323623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.323608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.325519 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.325493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-tls\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.325643 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.325523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/31436b55-2f8f-41f2-b299-509002fdfa78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.333626 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.333596 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxskf\" (UniqueName: \"kubernetes.io/projected/31436b55-2f8f-41f2-b299-509002fdfa78-kube-api-access-qxskf\") pod \"node-exporter-zbcw2\" (UID: \"31436b55-2f8f-41f2-b299-509002fdfa78\") " pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.386298 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.386189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.481608 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.481579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbcw2" Jul 07 15:43:35.492251 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:43:35.492216 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31436b55_2f8f_41f2_b299_509002fdfa78.slice/crio-89e72ad9785795169bdd6347d73b338c80c7b5bae0a0811eaca8af7453d6f491 WatchSource:0}: Error finding container 89e72ad9785795169bdd6347d73b338c80c7b5bae0a0811eaca8af7453d6f491: Status 404 returned error can't find the container with id 89e72ad9785795169bdd6347d73b338c80c7b5bae0a0811eaca8af7453d6f491 Jul 07 15:43:35.523589 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.523557 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.623521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.623490 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:35.857008 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:35.856969 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbcw2" event={"ID":"31436b55-2f8f-41f2-b299-509002fdfa78","Type":"ContainerStarted","Data":"89e72ad9785795169bdd6347d73b338c80c7b5bae0a0811eaca8af7453d6f491"} Jul 07 15:43:36.144680 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:36.144593 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:36.252615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:36.252578 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:36.753545 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:36.753515 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:36.862657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:36.862573 2556 generic.go:356] "Generic (PLEG): container finished" podID="31436b55-2f8f-41f2-b299-509002fdfa78" containerID="10bcda5b327c89afe2e3dfc9490eb0100f7eb4b6674a07431eac2d555c10b51b" exitCode=0 Jul 07 15:43:36.862657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:36.862634 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbcw2" event={"ID":"31436b55-2f8f-41f2-b299-509002fdfa78","Type":"ContainerDied","Data":"10bcda5b327c89afe2e3dfc9490eb0100f7eb4b6674a07431eac2d555c10b51b"} Jul 07 15:43:37.068670 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:37.068624 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:37.870456 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:37.870424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbcw2" event={"ID":"31436b55-2f8f-41f2-b299-509002fdfa78","Type":"ContainerStarted","Data":"9e912eebbdbb8fedd86d5e86d9c23f32173effbbd5912277c20a9186af7e3292"} Jul 07 15:43:37.870892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:37.870504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbcw2" event={"ID":"31436b55-2f8f-41f2-b299-509002fdfa78","Type":"ContainerStarted","Data":"9d9d8cb6e84d6115d2be0889b3ae93c2ba6f35c53aacaa32dac17e2104c8bcb7"} Jul 07 15:43:37.892957 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:37.892905 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zbcw2" podStartSLOduration=1.720526418 podStartE2EDuration="2.892890876s" totalImagesPullingTime="1.105169184s" totalInitContainerRuntime="67.195274ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:37.891461067 +0000 UTC m=+90.044239037" watchObservedRunningTime="2026-07-07 15:43:37.892890876 +0000 UTC m=+90.045668841" Jul 07 15:43:38.091837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.091805 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:38.186370 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.186264 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:38.286494 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.286462 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:38.461387 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.461301 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:38.559290 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.559259 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:38.817862 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:38.817836 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:39.806784 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:39.806751 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:39.904697 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:39.904664 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:40.003615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:40.003579 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:40.116366 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:40.116285 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:41.512780 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:41.512745 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:41.647457 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:41.647422 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:44.259444 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:44.259404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:44.358977 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:44.358943 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:44.676913 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:44.676881 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:44.772219 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:44.772170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:46.818751 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:46.818723 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69d9f686fb-dfqms" Jul 07 15:43:47.048986 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:47.048953 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:47.190024 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:47.189936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:47.354541 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:47.354501 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:47.591356 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:47.591325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:47.691577 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:47.691540 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:48.041523 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:48.041438 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:48.123529 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:48.123493 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:50.085398 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:50.085363 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:50.169305 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:50.169269 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:50.727387 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:50.727353 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:51.786820 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:51.786790 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xwxxm" Jul 07 15:43:54.125106 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:54.125057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:54.286538 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:54.286507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:56.475253 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:56.475199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:56.576170 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:56.576133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:43:56.650127 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:43:56.650096 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:03.049162 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:03.049128 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:03.150980 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:03.150946 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:05.218799 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:05.218733 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:05.383576 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:05.383543 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:05.478264 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:05.478148 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:06.969010 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:06.968978 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd4b8ac0-61ad-4035-b55a-128e5073a246" containerID="f78302e7dc5b6fee682905d730c0c507fead6273accc6aa871ca10b53b7766f5" exitCode=0 Jul 07 15:44:06.969435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:06.969029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" event={"ID":"dd4b8ac0-61ad-4035-b55a-128e5073a246","Type":"ContainerDied","Data":"f78302e7dc5b6fee682905d730c0c507fead6273accc6aa871ca10b53b7766f5"} Jul 07 15:44:06.969435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:06.969324 2556 scope.go:117] "RemoveContainer" containerID="f78302e7dc5b6fee682905d730c0c507fead6273accc6aa871ca10b53b7766f5" Jul 07 15:44:07.973951 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:07.973923 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-cbgxt" event={"ID":"dd4b8ac0-61ad-4035-b55a-128e5073a246","Type":"ContainerStarted","Data":"99b214e4bb9560edce3c93579f7ee7889dbb6c40c0566b507a3e4951f0afedb9"} Jul 07 15:44:08.440667 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:08.440633 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:11.636124 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:11.636077 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:11.764856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:11.764823 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:11.846021 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:11.845973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:13.460590 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:13.460556 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:13.538180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:13.538134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:18.036591 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:18.036558 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:18.120387 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:18.120359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:33.063017 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:33.062982 2556 generic.go:356] "Generic (PLEG): container finished" podID="03c12a1b-429d-4566-a2eb-d15a4d96ee37" containerID="b53b2ca81993eb2b4496de3c199603a55f08dd1c83365d79640519436f05faf6" exitCode=0 Jul 07 15:44:33.063448 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:33.063054 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" event={"ID":"03c12a1b-429d-4566-a2eb-d15a4d96ee37","Type":"ContainerDied","Data":"b53b2ca81993eb2b4496de3c199603a55f08dd1c83365d79640519436f05faf6"} Jul 07 15:44:33.063448 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:33.063399 2556 scope.go:117] "RemoveContainer" containerID="b53b2ca81993eb2b4496de3c199603a55f08dd1c83365d79640519436f05faf6" Jul 07 15:44:34.069422 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:34.069392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jknpk" event={"ID":"03c12a1b-429d-4566-a2eb-d15a4d96ee37","Type":"ContainerStarted","Data":"2854019c9d7c198d27d1390c03ae9d98670a0681e9b66be441374c0af5155dbe"} Jul 07 15:44:51.354869 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:51.354835 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:51.451983 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:51.451946 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:54.764955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:54.764920 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:54.865942 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:54.865914 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:54.967080 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:54.967034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:55.453735 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:55.453699 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:44:55.551455 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:44:55.551417 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:03.389251 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:03.389153 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:03.615872 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:03.615841 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:05.709356 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:05.709321 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:05.826440 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:05.826406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:05.915500 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:05.915462 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:18.093478 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:18.093446 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:45:18.192902 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:45:18.192874 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:00.239084 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:00.239048 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:00.335099 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:00.335071 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:04.134043 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:04.134014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:04.228557 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:04.228524 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:22.095134 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:22.095099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:22.995322 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:22.995292 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:25.921601 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:25.921567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:26.027184 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:26.027138 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:26.776960 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:26.776927 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:26.865248 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:26.865189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:27.331874 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:27.331846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:27.448860 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:27.448830 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:28.654957 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:28.654903 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:29.210010 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:29.209976 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:32.545364 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:32.545336 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:32.643408 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:32.643375 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:34.701810 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:34.701776 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:34.813155 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:34.813122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:38.017354 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:38.017317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:38.117664 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:38.117627 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:38.217573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:38.217545 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:44.670368 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:44.670334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:44.771930 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:44.771904 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:46.732948 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:46.732900 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:54.962633 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:54.962592 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:55.050463 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:55.050432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:59.286220 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:59.286175 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:59.398783 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:59.398746 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:46:59.932395 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:46:59.932364 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.455533 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.455502 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.559166 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.559133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.616145 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.616114 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt"] Jul 07 15:47:00.619121 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.619102 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.621485 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.621459 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 15:47:00.621613 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.621522 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 15:47:00.621613 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.621524 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 15:47:00.621613 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.621589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 15:47:00.621873 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.621855 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hvlrf\"" Jul 07 15:47:00.636640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.636608 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt"] Jul 07 15:47:00.753238 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.753138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tmg\" (UniqueName: \"kubernetes.io/projected/ec0005d4-0504-4eee-b540-a8a6af86ba9f-kube-api-access-g9tmg\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.753238 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.753176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.753238 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.753221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.753439 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.753287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.753439 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.753325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.785080 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.785056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.854312 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tmg\" (UniqueName: \"kubernetes.io/projected/ec0005d4-0504-4eee-b540-a8a6af86ba9f-kube-api-access-g9tmg\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.854484 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.854484 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.854484 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.854484 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.854844 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.854817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.856834 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.856811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec0005d4-0504-4eee-b540-a8a6af86ba9f-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.856923 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.856878 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.856923 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.856912 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec0005d4-0504-4eee-b540-a8a6af86ba9f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.868542 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.868517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tmg\" (UniqueName: \"kubernetes.io/projected/ec0005d4-0504-4eee-b540-a8a6af86ba9f-kube-api-access-g9tmg\") pod \"opendatahub-operator-controller-manager-865bb77d7b-dzwnt\" (UID: \"ec0005d4-0504-4eee-b540-a8a6af86ba9f\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:00.887072 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.887048 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:00.929280 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:00.929256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:01.004790 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.004722 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.060579 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.060549 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt"] Jul 07 15:47:01.063169 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:01.063145 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0005d4_0504_4eee_b540_a8a6af86ba9f.slice/crio-b6a316a7dd31ca6a87f6de57540eda05b3c6b3b941833af59acf11ed0b7b80be WatchSource:0}: Error finding container b6a316a7dd31ca6a87f6de57540eda05b3c6b3b941833af59acf11ed0b7b80be: Status 404 returned error can't find the container with id b6a316a7dd31ca6a87f6de57540eda05b3c6b3b941833af59acf11ed0b7b80be Jul 07 15:47:01.110229 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.110185 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.207227 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.207168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.311397 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.311364 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.413308 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.413273 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:01.565183 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:01.565102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" event={"ID":"ec0005d4-0504-4eee-b540-a8a6af86ba9f","Type":"ContainerStarted","Data":"b6a316a7dd31ca6a87f6de57540eda05b3c6b3b941833af59acf11ed0b7b80be"} Jul 07 15:47:04.577877 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:04.577843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" event={"ID":"ec0005d4-0504-4eee-b540-a8a6af86ba9f","Type":"ContainerStarted","Data":"0d5847c00e2ef22a77b4fe66b1f2ed8282d9a41e3e6eaa2181f20c26a4c5825d"} Jul 07 15:47:05.583047 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:05.583018 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec0005d4-0504-4eee-b540-a8a6af86ba9f" containerID="0d5847c00e2ef22a77b4fe66b1f2ed8282d9a41e3e6eaa2181f20c26a4c5825d" exitCode=0 Jul 07 15:47:05.583464 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:05.583071 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" event={"ID":"ec0005d4-0504-4eee-b540-a8a6af86ba9f","Type":"ContainerDied","Data":"0d5847c00e2ef22a77b4fe66b1f2ed8282d9a41e3e6eaa2181f20c26a4c5825d"} Jul 07 15:47:06.588822 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:06.588785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" event={"ID":"ec0005d4-0504-4eee-b540-a8a6af86ba9f","Type":"ContainerStarted","Data":"7da9b53df9efddb8f5a40db574591ecc74f008aa2b1a7dcf732da2b0bcf644df"} Jul 07 15:47:06.589341 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:06.588889 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:06.619622 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:06.619554 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" podStartSLOduration=1.990502641 podStartE2EDuration="6.619531964s" totalImagesPullingTime="3.53832204s" totalInitContainerRuntime="1.090707283s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:06.617542332 +0000 UTC m=+298.770320298" watchObservedRunningTime="2026-07-07 15:47:06.619531964 +0000 UTC m=+298.772309931" Jul 07 15:47:08.234788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:08.234762 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:47:08.243839 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:08.243812 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:47:08.246426 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:08.246403 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:47:11.012056 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:11.012022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.530847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:11.530812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:11.652283 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:11.652250 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:17.595502 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:17.595473 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-dzwnt" Jul 07 15:47:19.840590 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:19.840552 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:21.489475 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:21.489442 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:22.451184 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:22.451149 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.468259 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.468230 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xg7wk"] Jul 07 15:47:23.475241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.475220 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.480392 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.480371 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 15:47:23.480513 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.480422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tnh8x\"" Jul 07 15:47:23.499668 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.499641 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xg7wk"] Jul 07 15:47:23.606277 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.606242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fmks\" (UniqueName: \"kubernetes.io/projected/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-kube-api-access-5fmks\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.606448 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.606294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.627050 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.627013 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.707174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.707144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fmks\" (UniqueName: \"kubernetes.io/projected/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-kube-api-access-5fmks\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.707366 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.707189 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.707366 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:23.707306 2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 15:47:23.707437 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:23.707381 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert podName:ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08 nodeName:}" failed. No retries permitted until 2026-07-07 15:47:24.207365867 +0000 UTC m=+316.360143810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert") pod "odh-model-controller-7998c67dc4-xg7wk" (UID: "ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08") : secret "odh-model-controller-webhook-cert" not found Jul 07 15:47:23.725315 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.725240 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fmks\" (UniqueName: \"kubernetes.io/projected/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-kube-api-access-5fmks\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:23.817489 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.817452 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:23.981425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:23.981334 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:24.015959 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.015926 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ldgk6"] Jul 07 15:47:24.018006 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.017991 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.020668 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.020649 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 15:47:24.032523 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.032501 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ldgk6"] Jul 07 15:47:24.110974 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.110937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.111169 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.110994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztzt\" (UniqueName: \"kubernetes.io/projected/f69728ff-95a7-4160-99df-20f8715f8e84-kube-api-access-dztzt\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.211572 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.211537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:24.211742 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.211582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.211742 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.211626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztzt\" (UniqueName: \"kubernetes.io/projected/f69728ff-95a7-4160-99df-20f8715f8e84-kube-api-access-dztzt\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.211818 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:24.211738 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 07 15:47:24.211818 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:24.211813 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs podName:f69728ff-95a7-4160-99df-20f8715f8e84 nodeName:}" failed. No retries permitted until 2026-07-07 15:47:24.711791245 +0000 UTC m=+316.864569187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs") pod "model-serving-api-54d89bd5fc-ldgk6" (UID: "f69728ff-95a7-4160-99df-20f8715f8e84") : secret "model-serving-api-tls" not found Jul 07 15:47:24.214118 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.214094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08-cert\") pod \"odh-model-controller-7998c67dc4-xg7wk\" (UID: \"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08\") " pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:24.222269 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.222249 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztzt\" (UniqueName: \"kubernetes.io/projected/f69728ff-95a7-4160-99df-20f8715f8e84-kube-api-access-dztzt\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.233740 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.233678 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:24.387082 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.387049 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:24.528456 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.528320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xg7wk"] Jul 07 15:47:24.531026 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:24.530998 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7ea4b9_5929_48fb_aef7_bb2d2ec5fd08.slice/crio-c4a437f166608dcb23d02fe6b504d0be7ab84ee69bf15a186132c1d3adb6853b WatchSource:0}: Error finding container c4a437f166608dcb23d02fe6b504d0be7ab84ee69bf15a186132c1d3adb6853b: Status 404 returned error can't find the container with id c4a437f166608dcb23d02fe6b504d0be7ab84ee69bf15a186132c1d3adb6853b Jul 07 15:47:24.532398 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.532378 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:47:24.650289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.650246 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:24.654125 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.654099 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" event={"ID":"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08","Type":"ContainerStarted","Data":"c4a437f166608dcb23d02fe6b504d0be7ab84ee69bf15a186132c1d3adb6853b"} Jul 07 15:47:24.715778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.715736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.718200 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.718167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f69728ff-95a7-4160-99df-20f8715f8e84-tls-certs\") pod \"model-serving-api-54d89bd5fc-ldgk6\" (UID: \"f69728ff-95a7-4160-99df-20f8715f8e84\") " pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:24.928985 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:24.928955 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:25.061389 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:25.061360 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ldgk6"] Jul 07 15:47:25.063552 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:25.063522 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69728ff_95a7_4160_99df_20f8715f8e84.slice/crio-c822a5c74b5f966dd0fe615c7aaeedbc2db8ae862a16685cea622d1d3589ef55 WatchSource:0}: Error finding container c822a5c74b5f966dd0fe615c7aaeedbc2db8ae862a16685cea622d1d3589ef55: Status 404 returned error can't find the container with id c822a5c74b5f966dd0fe615c7aaeedbc2db8ae862a16685cea622d1d3589ef55 Jul 07 15:47:25.659847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:25.659815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" event={"ID":"f69728ff-95a7-4160-99df-20f8715f8e84","Type":"ContainerStarted","Data":"c822a5c74b5f966dd0fe615c7aaeedbc2db8ae862a16685cea622d1d3589ef55"} Jul 07 15:47:26.107327 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.107281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:26.322406 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.322368 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-6b46w"] Jul 07 15:47:26.325825 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.325793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.329288 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.328878 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 15:47:26.329288 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.328973 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cgfvb\"" Jul 07 15:47:26.329288 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.329117 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 15:47:26.340677 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.340006 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-6b46w"] Jul 07 15:47:26.353591 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.353499 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:26.433463 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.433388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxd9v\" (UniqueName: \"kubernetes.io/projected/52d8c119-23d1-401d-aa47-658eb6ccafbb-kube-api-access-nxd9v\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.433463 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.433434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d8c119-23d1-401d-aa47-658eb6ccafbb-tls-certs\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.433650 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.433497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d8c119-23d1-401d-aa47-658eb6ccafbb-tmp\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.534778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.534731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxd9v\" (UniqueName: \"kubernetes.io/projected/52d8c119-23d1-401d-aa47-658eb6ccafbb-kube-api-access-nxd9v\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.534778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.534782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d8c119-23d1-401d-aa47-658eb6ccafbb-tls-certs\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.535019 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.534823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d8c119-23d1-401d-aa47-658eb6ccafbb-tmp\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.537797 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.537718 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52d8c119-23d1-401d-aa47-658eb6ccafbb-tmp\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.540389 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.540364 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/52d8c119-23d1-401d-aa47-658eb6ccafbb-tls-certs\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.546409 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.546314 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxd9v\" (UniqueName: \"kubernetes.io/projected/52d8c119-23d1-401d-aa47-658eb6ccafbb-kube-api-access-nxd9v\") pod \"kube-auth-proxy-f99849b54-6b46w\" (UID: \"52d8c119-23d1-401d-aa47-658eb6ccafbb\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:26.642535 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:26.642500 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" Jul 07 15:47:27.517417 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.517357 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:27.521063 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.521033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.523193 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.523166 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 15:47:27.523193 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.523186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 15:47:27.523409 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.523238 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 15:47:27.523409 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.523334 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 15:47:27.523515 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.523505 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w9sbn\"" Jul 07 15:47:27.544482 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544451 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srnp4\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544824 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544657 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544824 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.544937 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.544816 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.551751 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.551724 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:27.557223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.557179 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:27.645937 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.645896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.645937 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.645937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srnp4\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646137 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646137 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646137 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646328 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646328 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646189 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.646885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.646821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.648573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.648547 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.648698 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.648628 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.648761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.648720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.648843 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.648828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.655382 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.655361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.655854 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.655826 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srnp4\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4\") pod \"istiod-openshift-gateway-7574459656-wjj48\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:27.772677 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.772599 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:27.834278 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:27.834244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:28.251837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.251800 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-6b46w"] Jul 07 15:47:28.256259 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:28.256236 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d8c119_23d1_401d_aa47_658eb6ccafbb.slice/crio-ff070c89582af1e755c67d1bddca6df1f3f8ebfecaa6b2b01755f91b21f8ba59 WatchSource:0}: Error finding container ff070c89582af1e755c67d1bddca6df1f3f8ebfecaa6b2b01755f91b21f8ba59: Status 404 returned error can't find the container with id ff070c89582af1e755c67d1bddca6df1f3f8ebfecaa6b2b01755f91b21f8ba59 Jul 07 15:47:28.274438 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.274302 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:28.276389 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:28.276360 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23321487_8509_4ad9_9c09_33d73a2f1922.slice/crio-c2ab2aaceb451a140b93b37ec32829202c77027c71c15bd1c085d442e3c328f6 WatchSource:0}: Error finding container c2ab2aaceb451a140b93b37ec32829202c77027c71c15bd1c085d442e3c328f6: Status 404 returned error can't find the container with id c2ab2aaceb451a140b93b37ec32829202c77027c71c15bd1c085d442e3c328f6 Jul 07 15:47:28.673790 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.673754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" event={"ID":"23321487-8509-4ad9-9c09-33d73a2f1922","Type":"ContainerStarted","Data":"c2ab2aaceb451a140b93b37ec32829202c77027c71c15bd1c085d442e3c328f6"} Jul 07 15:47:28.675047 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.675015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" event={"ID":"52d8c119-23d1-401d-aa47-658eb6ccafbb","Type":"ContainerStarted","Data":"ff070c89582af1e755c67d1bddca6df1f3f8ebfecaa6b2b01755f91b21f8ba59"} Jul 07 15:47:28.676777 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.676746 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" event={"ID":"f69728ff-95a7-4160-99df-20f8715f8e84","Type":"ContainerStarted","Data":"a271dbea65b6c3c0db14454cfad2d4594471bcffcbc12dd5ec14ff124a5eb4bb"} Jul 07 15:47:28.676892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.676884 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:28.678675 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.678654 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" event={"ID":"ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08","Type":"ContainerStarted","Data":"2441657872c0f4bb0ac752ba5d1a61dade206538202dccbb115e651898c1dd4b"} Jul 07 15:47:28.678895 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.678866 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:28.697020 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.696964 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" podStartSLOduration=2.6896092400000002 podStartE2EDuration="5.696946275s" totalImagesPullingTime="3.007337035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:28.696249587 +0000 UTC m=+320.849027553" watchObservedRunningTime="2026-07-07 15:47:28.696946275 +0000 UTC m=+320.849724232" Jul 07 15:47:28.715827 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.715776 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" podStartSLOduration=2.177367294 podStartE2EDuration="5.715760435s" totalImagesPullingTime="3.538393141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:28.714535599 +0000 UTC m=+320.867313564" watchObservedRunningTime="2026-07-07 15:47:28.715760435 +0000 UTC m=+320.868538400" Jul 07 15:47:28.930423 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:28.930329 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:31.170582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:31.170538 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:31.170894 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:31.170609 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:31.699721 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:31.699676 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" event={"ID":"23321487-8509-4ad9-9c09-33d73a2f1922","Type":"ContainerStarted","Data":"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3"} Jul 07 15:47:31.699890 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:31.699762 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:31.740194 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:31.740133 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" podStartSLOduration=1.848361583 podStartE2EDuration="4.740112398s" totalImagesPullingTime="2.891750815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:31.738022625 +0000 UTC m=+323.890800592" watchObservedRunningTime="2026-07-07 15:47:31.740112398 +0000 UTC m=+323.892890368" Jul 07 15:47:32.216355 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.216324 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:32.336413 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.336376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:32.512642 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.512613 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx"] Jul 07 15:47:32.514854 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.514812 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.517239 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.517196 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pbsx4\"" Jul 07 15:47:32.530372 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.530342 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx"] Jul 07 15:47:32.552623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.552589 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:32.590813 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.590813 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.590813 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51137311-0e69-4be3-9adc-512bcf66850c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590816 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c994j\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-kube-api-access-c994j\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590937 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.590997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.591083 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.591033 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51137311-0e69-4be3-9adc-512bcf66850c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692381 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c994j\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-kube-api-access-c994j\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51137311-0e69-4be3-9adc-512bcf66850c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692521 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692870 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692587 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51137311-0e69-4be3-9adc-512bcf66850c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692870 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.692870 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.693025 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.692962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.693692 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.693333 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.693692 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.693516 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.693692 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.693633 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.693988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.693798 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51137311-0e69-4be3-9adc-512bcf66850c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.695571 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.695544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51137311-0e69-4be3-9adc-512bcf66850c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.695711 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.695687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51137311-0e69-4be3-9adc-512bcf66850c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.706678 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.706649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.707775 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.707741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" event={"ID":"52d8c119-23d1-401d-aa47-658eb6ccafbb","Type":"ContainerStarted","Data":"550964bb698eb94c6a70aea40d964b28bb7ad57f9aa4fcc265ae69d327e69884"} Jul 07 15:47:32.709557 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.709532 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c994j\" (UniqueName: \"kubernetes.io/projected/51137311-0e69-4be3-9adc-512bcf66850c-kube-api-access-c994j\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4rl2jx\" (UID: \"51137311-0e69-4be3-9adc-512bcf66850c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.709723 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.709708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:32.742526 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.742467 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f99849b54-6b46w" podStartSLOduration=3.027900334 podStartE2EDuration="6.742450323s" totalImagesPullingTime="3.714549989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:32.740918138 +0000 UTC m=+324.893696105" watchObservedRunningTime="2026-07-07 15:47:32.742450323 +0000 UTC m=+324.895228288" Jul 07 15:47:32.752606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.752580 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:32.825058 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.825025 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:32.974021 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.973989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx"] Jul 07 15:47:32.976719 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:32.976689 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51137311_0e69_4be3_9adc_512bcf66850c.slice/crio-143969f79defd524c5a12ddec8959f71f2884756887e6e43316d53ea26beaf6c WatchSource:0}: Error finding container 143969f79defd524c5a12ddec8959f71f2884756887e6e43316d53ea26beaf6c: Status 404 returned error can't find the container with id 143969f79defd524c5a12ddec8959f71f2884756887e6e43316d53ea26beaf6c Jul 07 15:47:32.998273 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:32.998244 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:33.713854 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:33.713812 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" event={"ID":"51137311-0e69-4be3-9adc-512bcf66850c","Type":"ContainerStarted","Data":"143969f79defd524c5a12ddec8959f71f2884756887e6e43316d53ea26beaf6c"} Jul 07 15:47:35.369787 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.369747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:35.453606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.453576 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs"] Jul 07 15:47:35.456850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.456833 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.459140 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.459119 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wvltv\"" Jul 07 15:47:35.459533 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.459514 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq"] Jul 07 15:47:35.459833 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.459821 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 15:47:35.463940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.463692 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.466623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.465936 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 15:47:35.466623 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.466003 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7tvwj\"" Jul 07 15:47:35.469407 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.469384 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs"] Jul 07 15:47:35.473025 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.472975 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:35.476296 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.473500 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:35.476296 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.473614 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:47:35.476296 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.473972 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:35.476296 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.475596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq"] Jul 07 15:47:35.518223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.518181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5s7q\" (UniqueName: \"kubernetes.io/projected/ec077b5a-fba1-45a9-bb24-f07f062e3867-kube-api-access-v5s7q\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.518372 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.518246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2js4\" (UniqueName: \"kubernetes.io/projected/86d0b574-25e3-4709-a6e6-3737aeace71d-kube-api-access-l2js4\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.518372 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.518268 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.518479 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.518399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.619290 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.619251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.619491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.619340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5s7q\" (UniqueName: \"kubernetes.io/projected/ec077b5a-fba1-45a9-bb24-f07f062e3867-kube-api-access-v5s7q\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.619491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.619374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2js4\" (UniqueName: \"kubernetes.io/projected/86d0b574-25e3-4709-a6e6-3737aeace71d-kube-api-access-l2js4\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.619491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.619401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.619491 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:35.619426 2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 15:47:35.619709 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:35.619500 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert podName:86d0b574-25e3-4709-a6e6-3737aeace71d nodeName:}" failed. No retries permitted until 2026-07-07 15:47:36.119478016 +0000 UTC m=+328.272255979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert") pod "llmisvc-controller-manager-777c6bd7d5-nq9rq" (UID: "86d0b574-25e3-4709-a6e6-3737aeace71d") : secret "llmisvc-webhook-server-cert" not found Jul 07 15:47:35.619709 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:35.619535 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 15:47:35.619709 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:35.619584 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert podName:ec077b5a-fba1-45a9-bb24-f07f062e3867 nodeName:}" failed. No retries permitted until 2026-07-07 15:47:36.119567132 +0000 UTC m=+328.272345084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert") pod "kserve-controller-manager-d6f4b65b8-4rqjs" (UID: "ec077b5a-fba1-45a9-bb24-f07f062e3867") : secret "kserve-webhook-server-cert" not found Jul 07 15:47:35.636878 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.636799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2js4\" (UniqueName: \"kubernetes.io/projected/86d0b574-25e3-4709-a6e6-3737aeace71d-kube-api-access-l2js4\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:35.642503 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.642466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5s7q\" (UniqueName: \"kubernetes.io/projected/ec077b5a-fba1-45a9-bb24-f07f062e3867-kube-api-access-v5s7q\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:35.679614 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.679573 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:35.727092 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.727053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" event={"ID":"51137311-0e69-4be3-9adc-512bcf66850c","Type":"ContainerStarted","Data":"92962c3054e1fd8f2a96885caaaaefd25ddac5c17821ac32a85c72f51845ed2f"} Jul 07 15:47:35.817347 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.817321 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:35.825356 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.825337 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:35.923138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:35.923023 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:36.026601 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.026562 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:36.123301 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.123266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:36.123484 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.123332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:36.125763 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.125740 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86d0b574-25e3-4709-a6e6-3737aeace71d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nq9rq\" (UID: \"86d0b574-25e3-4709-a6e6-3737aeace71d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:36.125850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.125809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec077b5a-fba1-45a9-bb24-f07f062e3867-cert\") pod \"kserve-controller-manager-d6f4b65b8-4rqjs\" (UID: \"ec077b5a-fba1-45a9-bb24-f07f062e3867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:36.129521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.129498 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:47:36.371291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.371255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:36.379689 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.379660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:36.524437 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.524375 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" podStartSLOduration=2.030433867 podStartE2EDuration="4.524350783s" totalImagesPullingTime="2.493916916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:35.78993397 +0000 UTC m=+327.942711937" watchObservedRunningTime="2026-07-07 15:47:36.524350783 +0000 UTC m=+328.677128749" Jul 07 15:47:36.525369 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.525347 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs"] Jul 07 15:47:36.527869 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:36.527844 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec077b5a_fba1_45a9_bb24_f07f062e3867.slice/crio-b345c5d4e2c599580ca3df8ee82c87cb8d85f80a97f6cebf2f9929e8d3404067 WatchSource:0}: Error finding container b345c5d4e2c599580ca3df8ee82c87cb8d85f80a97f6cebf2f9929e8d3404067: Status 404 returned error can't find the container with id b345c5d4e2c599580ca3df8ee82c87cb8d85f80a97f6cebf2f9929e8d3404067 Jul 07 15:47:36.556862 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.556841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq"] Jul 07 15:47:36.558722 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:47:36.558695 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod86d0b574_25e3_4709_a6e6_3737aeace71d.slice/crio-4426f4ae0959539e33fbb6edf3a5b5cf00213b3f3fe026082d589362592828f3 WatchSource:0}: Error finding container 4426f4ae0959539e33fbb6edf3a5b5cf00213b3f3fe026082d589362592828f3: Status 404 returned error can't find the container with id 4426f4ae0959539e33fbb6edf3a5b5cf00213b3f3fe026082d589362592828f3 Jul 07 15:47:36.732065 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.731980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" event={"ID":"86d0b574-25e3-4709-a6e6-3737aeace71d","Type":"ContainerStarted","Data":"4426f4ae0959539e33fbb6edf3a5b5cf00213b3f3fe026082d589362592828f3"} Jul 07 15:47:36.733090 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.733072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" event={"ID":"ec077b5a-fba1-45a9-bb24-f07f062e3867","Type":"ContainerStarted","Data":"b345c5d4e2c599580ca3df8ee82c87cb8d85f80a97f6cebf2f9929e8d3404067"} Jul 07 15:47:36.830597 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:36.830570 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:37.153259 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.153223 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:37.153432 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.153409 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" podUID="23321487-8509-4ad9-9c09-33d73a2f1922" containerName="discovery" containerID="cri-o://a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3" gracePeriod=30 Jul 07 15:47:37.426635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.426608 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:37.535200 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535165 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535278 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srnp4\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535308 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535330 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535555 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535383 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535555 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535413 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.535555 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.535450 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig\") pod \"23321487-8509-4ad9-9c09-33d73a2f1922\" (UID: \"23321487-8509-4ad9-9c09-33d73a2f1922\") " Jul 07 15:47:37.536221 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.536175 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:47:37.538277 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538178 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4" (OuterVolumeSpecName: "kube-api-access-srnp4") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "kube-api-access-srnp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:37.538277 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538220 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:47:37.538450 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538264 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token" (OuterVolumeSpecName: "istio-token") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:47:37.538541 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538519 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs" (OuterVolumeSpecName: "local-certs") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:47:37.538660 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538641 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts" (OuterVolumeSpecName: "cacerts") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:47:37.538740 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.538724 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "23321487-8509-4ad9-9c09-33d73a2f1922" (UID: "23321487-8509-4ad9-9c09-33d73a2f1922"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:47:37.637111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637081 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-istio-token\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637108 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srnp4\" (UniqueName: \"kubernetes.io/projected/23321487-8509-4ad9-9c09-33d73a2f1922-kube-api-access-srnp4\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637117 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23321487-8509-4ad9-9c09-33d73a2f1922-local-certs\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637125 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-cacerts\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637133 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-ca-configmap\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637141 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-csr-dns-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.637339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.637150 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23321487-8509-4ad9-9c09-33d73a2f1922-istio-kubeconfig\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:47:37.739134 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739054 2556 generic.go:356] "Generic (PLEG): container finished" podID="23321487-8509-4ad9-9c09-33d73a2f1922" containerID="a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3" exitCode=0 Jul 07 15:47:37.739134 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739120 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" Jul 07 15:47:37.739354 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" event={"ID":"23321487-8509-4ad9-9c09-33d73a2f1922","Type":"ContainerDied","Data":"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3"} Jul 07 15:47:37.739354 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wjj48" event={"ID":"23321487-8509-4ad9-9c09-33d73a2f1922","Type":"ContainerDied","Data":"c2ab2aaceb451a140b93b37ec32829202c77027c71c15bd1c085d442e3c328f6"} Jul 07 15:47:37.739354 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739228 2556 scope.go:117] "RemoveContainer" containerID="a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3" Jul 07 15:47:37.739536 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.739513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:37.740785 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.740539 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4rl2jx" Jul 07 15:47:37.801491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.800784 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:37.802669 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.802642 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wjj48"] Jul 07 15:47:37.833384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.833357 2556 scope.go:117] "RemoveContainer" containerID="a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3" Jul 07 15:47:37.833785 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:47:37.833753 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3\": container with ID starting with a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3 not found: ID does not exist" containerID="a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3" Jul 07 15:47:37.833891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:37.833798 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3"} err="failed to get container status \"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3\": rpc error: code = NotFound desc = could not find container \"a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3\": container with ID starting with a3622d98278239b6c0069397e771a7cfb5a68edc79fb1cff8af1d422d06122a3 not found: ID does not exist" Jul 07 15:47:38.420142 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:38.420106 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23321487-8509-4ad9-9c09-33d73a2f1922" path="/var/lib/kubelet/pods/23321487-8509-4ad9-9c09-33d73a2f1922/volumes" Jul 07 15:47:39.687255 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:39.687195 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xg7wk" Jul 07 15:47:39.690606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:39.690580 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ldgk6" Jul 07 15:47:40.755427 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:40.755391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" event={"ID":"86d0b574-25e3-4709-a6e6-3737aeace71d","Type":"ContainerStarted","Data":"1c40fb4796e9718a03362e38cc94b64e3f08ce0583b5395eef649775bf75ad72"} Jul 07 15:47:40.755854 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:40.755539 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:47:40.756910 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:40.756888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" event={"ID":"ec077b5a-fba1-45a9-bb24-f07f062e3867","Type":"ContainerStarted","Data":"8c4a7f8654439bf45095c6ca68cd18ff5321f5b76fd69a80ddca0a6e2cd0f224"} Jul 07 15:47:40.757008 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:40.756941 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:47:40.799252 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:47:40.799160 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" podStartSLOduration=2.435467875 podStartE2EDuration="5.799137974s" totalImagesPullingTime="3.363670099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:40.797404328 +0000 UTC m=+332.950182304" watchObservedRunningTime="2026-07-07 15:47:40.799137974 +0000 UTC m=+332.951915944" Jul 07 15:48:11.763700 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:11.763672 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nq9rq" Jul 07 15:48:11.766586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:11.766566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" Jul 07 15:48:11.783241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:11.783181 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4rqjs" podStartSLOduration=33.394487891 podStartE2EDuration="36.783164891s" totalImagesPullingTime="3.388677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:40.833647038 +0000 UTC m=+332.986425004" watchObservedRunningTime="2026-07-07 15:48:11.783164891 +0000 UTC m=+363.935942855" Jul 07 15:48:21.362580 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.362542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:21.454722 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.454687 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:21.504416 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.504385 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:21.504741 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.504726 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23321487-8509-4ad9-9c09-33d73a2f1922" containerName="discovery" Jul 07 15:48:21.504799 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.504743 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="23321487-8509-4ad9-9c09-33d73a2f1922" containerName="discovery" Jul 07 15:48:21.504837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.504804 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="23321487-8509-4ad9-9c09-33d73a2f1922" containerName="discovery" Jul 07 15:48:21.516925 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.516864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:21.519979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.519953 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:48:21.520144 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.520124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:21.520241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.520123 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:48:21.520738 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.520716 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8h5w2\"" Jul 07 15:48:21.576219 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.576177 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:21.611150 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.611119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnjch\" (UniqueName: \"kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch\") pod \"kuadrant-operator-catalog-wqpjq\" (UID: \"4e4332ed-feba-4c4a-a6f3-bbcaadc82914\") " pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:21.712005 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.711912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnjch\" (UniqueName: \"kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch\") pod \"kuadrant-operator-catalog-wqpjq\" (UID: \"4e4332ed-feba-4c4a-a6f3-bbcaadc82914\") " pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:21.722254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.722228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnjch\" (UniqueName: \"kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch\") pod \"kuadrant-operator-catalog-wqpjq\" (UID: \"4e4332ed-feba-4c4a-a6f3-bbcaadc82914\") " pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:21.829322 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.829286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:21.852817 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.852782 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:21.958904 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:21.958849 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:21.961062 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:48:21.961035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4332ed_feba_4c4a_a6f3_bbcaadc82914.slice/crio-5f7c41743202e428c4761cefd76cf1a857d1adb960c779970d8b214f7419bf16 WatchSource:0}: Error finding container 5f7c41743202e428c4761cefd76cf1a857d1adb960c779970d8b214f7419bf16: Status 404 returned error can't find the container with id 5f7c41743202e428c4761cefd76cf1a857d1adb960c779970d8b214f7419bf16 Jul 07 15:48:22.067034 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.066998 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgrkt"] Jul 07 15:48:22.069652 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.069629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:22.080020 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.080000 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgrkt"] Jul 07 15:48:22.115174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.115142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkxs\" (UniqueName: \"kubernetes.io/projected/49b6ff20-dcf4-4b85-9e49-466d6583ee88-kube-api-access-tfkxs\") pod \"kuadrant-operator-catalog-sgrkt\" (UID: \"49b6ff20-dcf4-4b85-9e49-466d6583ee88\") " pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:22.216477 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.216385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkxs\" (UniqueName: \"kubernetes.io/projected/49b6ff20-dcf4-4b85-9e49-466d6583ee88-kube-api-access-tfkxs\") pod \"kuadrant-operator-catalog-sgrkt\" (UID: \"49b6ff20-dcf4-4b85-9e49-466d6583ee88\") " pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:22.225538 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.225516 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkxs\" (UniqueName: \"kubernetes.io/projected/49b6ff20-dcf4-4b85-9e49-466d6583ee88-kube-api-access-tfkxs\") pod \"kuadrant-operator-catalog-sgrkt\" (UID: \"49b6ff20-dcf4-4b85-9e49-466d6583ee88\") " pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:22.301367 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.301338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:22.379108 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.379077 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:22.502913 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.502841 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:22.508960 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.508936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgrkt"] Jul 07 15:48:22.511604 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:48:22.511580 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b6ff20_dcf4_4b85_9e49_466d6583ee88.slice/crio-e1528861f2dc60a5b668a3f1794c1b72dc5b8d426aaa19964cd303416529a6b5 WatchSource:0}: Error finding container e1528861f2dc60a5b668a3f1794c1b72dc5b8d426aaa19964cd303416529a6b5: Status 404 returned error can't find the container with id e1528861f2dc60a5b668a3f1794c1b72dc5b8d426aaa19964cd303416529a6b5 Jul 07 15:48:22.930252 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.930192 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" event={"ID":"49b6ff20-dcf4-4b85-9e49-466d6583ee88","Type":"ContainerStarted","Data":"e1528861f2dc60a5b668a3f1794c1b72dc5b8d426aaa19964cd303416529a6b5"} Jul 07 15:48:22.931511 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:22.931487 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" event={"ID":"4e4332ed-feba-4c4a-a6f3-bbcaadc82914","Type":"ContainerStarted","Data":"5f7c41743202e428c4761cefd76cf1a857d1adb960c779970d8b214f7419bf16"} Jul 07 15:48:24.944395 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:24.944358 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" event={"ID":"49b6ff20-dcf4-4b85-9e49-466d6583ee88","Type":"ContainerStarted","Data":"6cced4bda67a13ebe1d913bf58b39404e634fca5f6c19d93e423b751e94f003d"} Jul 07 15:48:24.945931 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:24.945905 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" event={"ID":"4e4332ed-feba-4c4a-a6f3-bbcaadc82914","Type":"ContainerStarted","Data":"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6"} Jul 07 15:48:24.946025 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:24.945968 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" podUID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" containerName="registry-server" containerID="cri-o://53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6" gracePeriod=2 Jul 07 15:48:24.966327 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:24.966284 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" podStartSLOduration=1.545033166 podStartE2EDuration="2.966270191s" totalImagesPullingTime="1.421237025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:24.965263234 +0000 UTC m=+377.118041199" watchObservedRunningTime="2026-07-07 15:48:24.966270191 +0000 UTC m=+377.119048156" Jul 07 15:48:24.984683 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:24.984643 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" podStartSLOduration=2.013687598 podStartE2EDuration="3.984629223s" totalImagesPullingTime="1.970941625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:24.983818393 +0000 UTC m=+377.136596357" watchObservedRunningTime="2026-07-07 15:48:24.984629223 +0000 UTC m=+377.137407188" Jul 07 15:48:25.189299 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.189275 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:25.240543 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.240467 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnjch\" (UniqueName: \"kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch\") pod \"4e4332ed-feba-4c4a-a6f3-bbcaadc82914\" (UID: \"4e4332ed-feba-4c4a-a6f3-bbcaadc82914\") " Jul 07 15:48:25.242710 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.242686 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch" (OuterVolumeSpecName: "kube-api-access-jnjch") pod "4e4332ed-feba-4c4a-a6f3-bbcaadc82914" (UID: "4e4332ed-feba-4c4a-a6f3-bbcaadc82914"). InnerVolumeSpecName "kube-api-access-jnjch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:48:25.341408 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.341377 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnjch\" (UniqueName: \"kubernetes.io/projected/4e4332ed-feba-4c4a-a6f3-bbcaadc82914-kube-api-access-jnjch\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:48:25.956416 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.956350 2556 generic.go:356] "Generic (PLEG): container finished" podID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" containerID="53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6" exitCode=0 Jul 07 15:48:25.956850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.956426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" event={"ID":"4e4332ed-feba-4c4a-a6f3-bbcaadc82914","Type":"ContainerDied","Data":"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6"} Jul 07 15:48:25.956850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.956463 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" Jul 07 15:48:25.956850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.956565 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqpjq" event={"ID":"4e4332ed-feba-4c4a-a6f3-bbcaadc82914","Type":"ContainerDied","Data":"5f7c41743202e428c4761cefd76cf1a857d1adb960c779970d8b214f7419bf16"} Jul 07 15:48:25.956850 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.956611 2556 scope.go:117] "RemoveContainer" containerID="53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6" Jul 07 15:48:25.965606 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.965587 2556 scope.go:117] "RemoveContainer" containerID="53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6" Jul 07 15:48:25.965843 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:48:25.965826 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6\": container with ID starting with 53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6 not found: ID does not exist" containerID="53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6" Jul 07 15:48:25.965906 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.965849 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6"} err="failed to get container status \"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6\": rpc error: code = NotFound desc = could not find container \"53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6\": container with ID starting with 53175049a3608a4e66a8d64d79cabb26ed3d317bc6c8e59f5e51042251a49ab6 not found: ID does not exist" Jul 07 15:48:25.981119 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.981094 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:25.990305 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:25.990286 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqpjq"] Jul 07 15:48:26.419416 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:26.419387 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" path="/var/lib/kubelet/pods/4e4332ed-feba-4c4a-a6f3-bbcaadc82914/volumes" Jul 07 15:48:32.379821 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:32.379785 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:32.380276 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:32.379862 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:32.402084 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:32.402057 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:33.007831 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:33.007805 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sgrkt" Jul 07 15:48:46.730951 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:46.730916 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:46.832548 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:46.832520 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:50.841734 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:50.841699 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:53.506960 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.506925 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b"] Jul 07 15:48:53.507350 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.507264 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" containerName="registry-server" Jul 07 15:48:53.507350 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.507276 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" containerName="registry-server" Jul 07 15:48:53.507350 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.507328 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e4332ed-feba-4c4a-a6f3-bbcaadc82914" containerName="registry-server" Jul 07 15:48:53.513520 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.513501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:53.517057 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.517039 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 15:48:53.517163 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.517085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7skgp\"" Jul 07 15:48:53.526823 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.526804 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b"] Jul 07 15:48:53.564396 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.564362 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vqz\" (UniqueName: \"kubernetes.io/projected/b605df2b-92d8-42b4-a2d4-6347bfa21e59-kube-api-access-t9vqz\") pod \"dns-operator-controller-manager-864dd78c4c-24w9b\" (UID: \"b605df2b-92d8-42b4-a2d4-6347bfa21e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:53.664766 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.664726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vqz\" (UniqueName: \"kubernetes.io/projected/b605df2b-92d8-42b4-a2d4-6347bfa21e59-kube-api-access-t9vqz\") pod \"dns-operator-controller-manager-864dd78c4c-24w9b\" (UID: \"b605df2b-92d8-42b4-a2d4-6347bfa21e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:53.675316 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.675286 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vqz\" (UniqueName: \"kubernetes.io/projected/b605df2b-92d8-42b4-a2d4-6347bfa21e59-kube-api-access-t9vqz\") pod \"dns-operator-controller-manager-864dd78c4c-24w9b\" (UID: \"b605df2b-92d8-42b4-a2d4-6347bfa21e59\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:53.822809 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.822778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:53.956321 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:53.956288 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b"] Jul 07 15:48:53.960358 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:48:53.960331 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb605df2b_92d8_42b4_a2d4_6347bfa21e59.slice/crio-ddeac1ecb2c5fd914a4a73020cf1db6f967574b242591c3b4e275f057059af7d WatchSource:0}: Error finding container ddeac1ecb2c5fd914a4a73020cf1db6f967574b242591c3b4e275f057059af7d: Status 404 returned error can't find the container with id ddeac1ecb2c5fd914a4a73020cf1db6f967574b242591c3b4e275f057059af7d Jul 07 15:48:54.073377 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:54.073293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" event={"ID":"b605df2b-92d8-42b4-a2d4-6347bfa21e59","Type":"ContainerStarted","Data":"ddeac1ecb2c5fd914a4a73020cf1db6f967574b242591c3b4e275f057059af7d"} Jul 07 15:48:54.458950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:54.458877 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:56.082915 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:56.082886 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" event={"ID":"b605df2b-92d8-42b4-a2d4-6347bfa21e59","Type":"ContainerStarted","Data":"40913b0e8acbc6d978e66f7cb7512a25be02835abf5e5993064d93b30721f049"} Jul 07 15:48:56.083323 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:56.082994 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:48:56.105927 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:56.105879 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" podStartSLOduration=1.3038049809999999 podStartE2EDuration="3.10586313s" totalImagesPullingTime="1.802058149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:56.104440161 +0000 UTC m=+408.257218127" watchObservedRunningTime="2026-07-07 15:48:56.10586313 +0000 UTC m=+408.258641094" Jul 07 15:48:57.499026 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:57.498995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:57.770642 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:57.770566 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:57.874367 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:57.874332 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:57.975393 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:57.975359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:58.982624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:58.982576 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:48:59.395136 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.395101 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw"] Jul 07 15:48:59.399942 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.399926 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.402162 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.402140 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wsqzl\"" Jul 07 15:48:59.412441 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.412421 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw"] Jul 07 15:48:59.516806 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.516763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.517006 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.516822 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2prk\" (UniqueName: \"kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.618182 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.618144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.618182 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.618187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2prk\" (UniqueName: \"kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.618608 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.618585 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.630968 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.630942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2prk\" (UniqueName: \"kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.709547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.709466 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:48:59.850946 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.850909 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw"] Jul 07 15:48:59.855382 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:48:59.855348 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792f2a8f_9da2_4293_a792_ecc6bf4546bc.slice/crio-0ef932c128363600d2df4336c75b11118565e86c4de87f0c8c218d5f4432f3ba WatchSource:0}: Error finding container 0ef932c128363600d2df4336c75b11118565e86c4de87f0c8c218d5f4432f3ba: Status 404 returned error can't find the container with id 0ef932c128363600d2df4336c75b11118565e86c4de87f0c8c218d5f4432f3ba Jul 07 15:48:59.856246 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:48:59.856197 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:00.103177 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:00.103140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" event={"ID":"792f2a8f-9da2-4293-a792-ecc6bf4546bc","Type":"ContainerStarted","Data":"0ef932c128363600d2df4336c75b11118565e86c4de87f0c8c218d5f4432f3ba"} Jul 07 15:49:01.794886 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:01.794853 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm"] Jul 07 15:49:01.798000 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:01.797981 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:01.800289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:01.800266 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ggfzz\"" Jul 07 15:49:01.814461 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:01.814432 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm"] Jul 07 15:49:01.937419 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:01.937381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-895pv\" (UniqueName: \"kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv\") pod \"limitador-operator-controller-manager-859d7b78bd-w62hm\" (UID: \"6f01d9f6-a971-465a-960a-65c84a439a6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:02.038450 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.038411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-895pv\" (UniqueName: \"kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv\") pod \"limitador-operator-controller-manager-859d7b78bd-w62hm\" (UID: \"6f01d9f6-a971-465a-960a-65c84a439a6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:02.047338 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.047303 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:02.057714 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.057684 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-895pv\" (UniqueName: \"kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv\") pod \"limitador-operator-controller-manager-859d7b78bd-w62hm\" (UID: \"6f01d9f6-a971-465a-960a-65c84a439a6a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:02.108504 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.108471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:02.251828 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.251802 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm"] Jul 07 15:49:02.253801 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:49:02.253769 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f01d9f6_a971_465a_960a_65c84a439a6a.slice/crio-54f35212fe478ce5b97d9a5ea145b6d422429f8cfc5a6f4033d38083f0648723 WatchSource:0}: Error finding container 54f35212fe478ce5b97d9a5ea145b6d422429f8cfc5a6f4033d38083f0648723: Status 404 returned error can't find the container with id 54f35212fe478ce5b97d9a5ea145b6d422429f8cfc5a6f4033d38083f0648723 Jul 07 15:49:02.458993 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.458906 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:02.711868 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.711797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:02.814982 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:02.814949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:03.122699 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:03.122664 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" event={"ID":"6f01d9f6-a971-465a-960a-65c84a439a6a","Type":"ContainerStarted","Data":"54f35212fe478ce5b97d9a5ea145b6d422429f8cfc5a6f4033d38083f0648723"} Jul 07 15:49:05.496270 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:05.496181 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:06.136595 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.136559 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" event={"ID":"6f01d9f6-a971-465a-960a-65c84a439a6a","Type":"ContainerStarted","Data":"7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78"} Jul 07 15:49:06.136777 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.136625 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:06.138182 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.138156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" event={"ID":"792f2a8f-9da2-4293-a792-ecc6bf4546bc","Type":"ContainerStarted","Data":"f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265"} Jul 07 15:49:06.138300 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.138202 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:06.156726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.156662 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" podStartSLOduration=2.314692164 podStartE2EDuration="5.156641728s" totalImagesPullingTime="2.841949564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:06.15559557 +0000 UTC m=+418.308373565" watchObservedRunningTime="2026-07-07 15:49:06.156641728 +0000 UTC m=+418.309419694" Jul 07 15:49:06.177770 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.177720 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" podStartSLOduration=1.9255876280000002 podStartE2EDuration="7.177705441s" totalImagesPullingTime="5.252117813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:06.176683551 +0000 UTC m=+418.329461516" watchObservedRunningTime="2026-07-07 15:49:06.177705441 +0000 UTC m=+418.330483406" Jul 07 15:49:06.876450 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.876415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:06.974935 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:06.974906 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:07.089291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:07.089260 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-24w9b" Jul 07 15:49:08.197420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.197391 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf"] Jul 07 15:49:08.200717 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.200701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.202863 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.202840 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 15:49:08.202991 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.202885 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 15:49:08.203162 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.203148 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8hpb\"" Jul 07 15:49:08.210972 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.210950 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf"] Jul 07 15:49:08.211949 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.211926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:08.290038 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.290006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.290195 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.290080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.290195 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.290136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5rjz\" (UniqueName: \"kubernetes.io/projected/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-kube-api-access-z5rjz\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.391162 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.391125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5rjz\" (UniqueName: \"kubernetes.io/projected/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-kube-api-access-z5rjz\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.391349 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.391183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.391349 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.391275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.391922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.391898 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.393720 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.393686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.406385 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.406353 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5rjz\" (UniqueName: \"kubernetes.io/projected/8402f8c8-68b2-4df8-8b2b-e0125e38a1d8-kube-api-access-z5rjz\") pod \"kuadrant-console-plugin-66b5774985-l4bzf\" (UID: \"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.445389 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.445360 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:08.511480 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.511407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" Jul 07 15:49:08.645734 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:08.645698 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf"] Jul 07 15:49:08.649079 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:49:08.649052 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8402f8c8_68b2_4df8_8b2b_e0125e38a1d8.slice/crio-f6b4c3b244043a1d7c59f7b421a1ac7ffe5f342a7a3bafe753b1ba5716a64a86 WatchSource:0}: Error finding container f6b4c3b244043a1d7c59f7b421a1ac7ffe5f342a7a3bafe753b1ba5716a64a86: Status 404 returned error can't find the container with id f6b4c3b244043a1d7c59f7b421a1ac7ffe5f342a7a3bafe753b1ba5716a64a86 Jul 07 15:49:09.152996 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:09.152958 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" event={"ID":"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8","Type":"ContainerStarted","Data":"f6b4c3b244043a1d7c59f7b421a1ac7ffe5f342a7a3bafe753b1ba5716a64a86"} Jul 07 15:49:10.649004 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:10.648970 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:10.719558 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:10.719517 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:12.105421 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:12.105376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:12.205299 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:12.205261 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:17.146619 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:17.146587 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:17.147111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:17.146755 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:18.119417 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.119376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:18.418332 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.418251 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:18.583486 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.583448 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4"] Jul 07 15:49:18.606018 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.605528 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4"] Jul 07 15:49:18.606018 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.605651 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.686659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.686575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.686659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.686648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdxt\" (UniqueName: \"kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.787939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.787907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.788136 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.787954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdxt\" (UniqueName: \"kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.788291 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.788271 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.801303 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.801264 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdxt\" (UniqueName: \"kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt\") pod \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.919607 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.919568 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:18.926901 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.926867 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4"] Jul 07 15:49:18.937937 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.937864 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4"] Jul 07 15:49:18.953242 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.953184 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw"] Jul 07 15:49:18.953500 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.953464 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" containerName="manager" containerID="cri-o://f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265" gracePeriod=2 Jul 07 15:49:18.955131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.955105 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:18.960939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.960919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:18.969321 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.969267 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw"] Jul 07 15:49:18.974347 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.974325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:18.981806 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:18.981646 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"792f2a8f-9da2-4293-a792-ecc6bf4546bc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-d4llw\": pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:18.984771 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:18.984739 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:18.986387 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.986190 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:18.986689 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.986672 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" containerName="manager" Jul 07 15:49:18.986756 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.986692 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" containerName="manager" Jul 07 15:49:18.986810 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.986791 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" containerName="manager" Jul 07 15:49:18.989288 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.989260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9wb\" (UniqueName: \"kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:18.989428 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.989404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:18.991138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.991119 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm"] Jul 07 15:49:18.991287 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.991264 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:18.991388 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:18.991351 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" containerName="manager" containerID="cri-o://7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78" gracePeriod=2 Jul 07 15:49:19.002035 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.002006 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm"] Jul 07 15:49:19.004754 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.004719 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:19.021067 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:19.021032 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:19.047136 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:19.047089 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:19.090940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.090902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88bj\" (UniqueName: \"kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.091102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.090988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9wb\" (UniqueName: \"kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:19.091102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.091089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:19.091198 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.091117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.091517 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.091488 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:19.104680 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.104642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9wb\" (UniqueName: \"kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb\") pod \"kuadrant-operator-controller-manager-55467d9f7-zblf6\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:19.191756 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.191664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.191922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.191758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88bj\" (UniqueName: \"kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.192091 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.192069 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.203517 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.203490 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88bj\" (UniqueName: \"kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7zwc9\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:19.276547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.276516 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:19.370472 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:19.370437 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:22.972164 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:22.972127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:23.114510 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:23.114470 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:25.476220 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:25.476168 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:25.575388 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:25.575351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:28.941884 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:28.941839 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:29.045771 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:29.045705 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:30.947827 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:30.947624 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:30.952153 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:49:30.952113 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f50e70_de12_4d6d_8d2a_a9c601c3f847.slice/crio-20fae244a76f837e52523ba9aff21cab5abe5270f6ed47bcc648c990d5dd3dc4 WatchSource:0}: Error finding container 20fae244a76f837e52523ba9aff21cab5abe5270f6ed47bcc648c990d5dd3dc4: Status 404 returned error can't find the container with id 20fae244a76f837e52523ba9aff21cab5abe5270f6ed47bcc648c990d5dd3dc4 Jul 07 15:49:30.975894 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:30.975865 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:31.122291 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:49:31.122256 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab347de_07ae_4594_9106_a82b1e8c14da.slice/crio-c706c702cd3351b8d2dfc31a93fe5fab047aebc71c6728125a4dcd56e7eced9f WatchSource:0}: Error finding container c706c702cd3351b8d2dfc31a93fe5fab047aebc71c6728125a4dcd56e7eced9f: Status 404 returned error can't find the container with id c706c702cd3351b8d2dfc31a93fe5fab047aebc71c6728125a4dcd56e7eced9f Jul 07 15:49:31.150019 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.149992 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.152084 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.152055 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.173653 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.173627 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.175593 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.175566 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.177405 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.177368 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.194762 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.194733 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2prk\" (UniqueName: \"kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk\") pod \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " Jul 07 15:49:31.194865 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.194820 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume\") pod \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\" (UID: \"792f2a8f-9da2-4293-a792-ecc6bf4546bc\") " Jul 07 15:49:31.195224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.195179 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "792f2a8f-9da2-4293-a792-ecc6bf4546bc" (UID: "792f2a8f-9da2-4293-a792-ecc6bf4546bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:49:31.196904 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.196884 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk" (OuterVolumeSpecName: "kube-api-access-p2prk") pod "792f2a8f-9da2-4293-a792-ecc6bf4546bc" (UID: "792f2a8f-9da2-4293-a792-ecc6bf4546bc"). InnerVolumeSpecName "kube-api-access-p2prk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:31.270635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.270602 2556 generic.go:356] "Generic (PLEG): container finished" podID="6f01d9f6-a971-465a-960a-65c84a439a6a" containerID="7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78" exitCode=0 Jul 07 15:49:31.270764 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.270654 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.270764 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.270695 2556 scope.go:117] "RemoveContainer" containerID="7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78" Jul 07 15:49:31.272880 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.272848 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.273135 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.273037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" event={"ID":"c5f50e70-de12-4d6d-8d2a-a9c601c3f847","Type":"ContainerStarted","Data":"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022"} Jul 07 15:49:31.273135 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.273097 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" event={"ID":"c5f50e70-de12-4d6d-8d2a-a9c601c3f847","Type":"ContainerStarted","Data":"20fae244a76f837e52523ba9aff21cab5abe5270f6ed47bcc648c990d5dd3dc4"} Jul 07 15:49:31.274784 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.274674 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.274964 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.274942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" event={"ID":"7ab347de-07ae-4594-9106-a82b1e8c14da","Type":"ContainerStarted","Data":"c706c702cd3351b8d2dfc31a93fe5fab047aebc71c6728125a4dcd56e7eced9f"} Jul 07 15:49:31.276786 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.276762 2556 generic.go:356] "Generic (PLEG): container finished" podID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" containerID="f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265" exitCode=0 Jul 07 15:49:31.276892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.276861 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.279110 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.279087 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.281123 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.281099 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.281460 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.281442 2556 scope.go:117] "RemoveContainer" containerID="7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78" Jul 07 15:49:31.281757 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.281730 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78\": container with ID starting with 7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78 not found: ID does not exist" containerID="7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78" Jul 07 15:49:31.281823 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.281769 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78"} err="failed to get container status \"7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78\": rpc error: code = NotFound desc = could not find container \"7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78\": container with ID starting with 7aaa2fe99ceaa8009f487199b665b2d86024fd1791caed70d643e362b2950a78 not found: ID does not exist" Jul 07 15:49:31.281823 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.281791 2556 scope.go:117] "RemoveContainer" containerID="f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265" Jul 07 15:49:31.290053 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.290028 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.290590 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.290576 2556 scope.go:117] "RemoveContainer" containerID="f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265" Jul 07 15:49:31.290863 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.290837 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265\": container with ID starting with f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265 not found: ID does not exist" containerID="f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265" Jul 07 15:49:31.290931 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.290870 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265"} err="failed to get container status \"f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265\": rpc error: code = NotFound desc = could not find container \"f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265\": container with ID starting with f247f5df33f64f4a7086f829d7adf6851a470c7e260c4e391320ef61ef0cc265 not found: ID does not exist" Jul 07 15:49:31.291531 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.291508 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:31.295951 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.295935 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-895pv\" (UniqueName: \"kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv\") pod \"6f01d9f6-a971-465a-960a-65c84a439a6a\" (UID: \"6f01d9f6-a971-465a-960a-65c84a439a6a\") " Jul 07 15:49:31.296152 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.296140 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/792f2a8f-9da2-4293-a792-ecc6bf4546bc-extensions-socket-volume\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:31.296187 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.296154 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2prk\" (UniqueName: \"kubernetes.io/projected/792f2a8f-9da2-4293-a792-ecc6bf4546bc-kube-api-access-p2prk\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:31.297834 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.297814 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv" (OuterVolumeSpecName: "kube-api-access-895pv") pod "6f01d9f6-a971-465a-960a-65c84a439a6a" (UID: "6f01d9f6-a971-465a-960a-65c84a439a6a"). InnerVolumeSpecName "kube-api-access-895pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:31.396788 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:31.396716 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-895pv\" (UniqueName: \"kubernetes.io/projected/6f01d9f6-a971-465a-960a-65c84a439a6a-kube-api-access-895pv\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:31.583830 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.583795 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:31.585349 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:31.585322 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:32.283124 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.283089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" event={"ID":"7ab347de-07ae-4594-9106-a82b1e8c14da","Type":"ContainerStarted","Data":"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a"} Jul 07 15:49:32.283561 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.283187 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:32.284764 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.284738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" event={"ID":"8402f8c8-68b2-4df8-8b2b-e0125e38a1d8","Type":"ContainerStarted","Data":"8961736a6039e1d1349ed7e50b2f2b518eefded7c8998c97c250616e993b582e"} Jul 07 15:49:32.284904 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:32.284847 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:32.286639 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.286622 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:32.311900 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:32.311873 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:32.312454 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.312421 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" podStartSLOduration=14.312409641 podStartE2EDuration="14.312409641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:32.310140264 +0000 UTC m=+444.462918241" watchObservedRunningTime="2026-07-07 15:49:32.312409641 +0000 UTC m=+444.465187606" Jul 07 15:49:32.313498 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:32.313479 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d4llw\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d4llw" Jul 07 15:49:32.314770 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:32.314751 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w62hm\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w62hm" Jul 07 15:49:32.337151 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.337114 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-l4bzf" podStartSLOduration=1.791515374 podStartE2EDuration="24.337101484s" totalImagesPullingTime="22.54558611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:32.335921149 +0000 UTC m=+444.488699115" watchObservedRunningTime="2026-07-07 15:49:32.337101484 +0000 UTC m=+444.489879449" Jul 07 15:49:32.360614 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.360569 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" podStartSLOduration=14.360550644 podStartE2EDuration="14.360550644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:32.360424675 +0000 UTC m=+444.513202645" watchObservedRunningTime="2026-07-07 15:49:32.360550644 +0000 UTC m=+444.513328610" Jul 07 15:49:32.418750 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.418716 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" path="/var/lib/kubelet/pods/6f01d9f6-a971-465a-960a-65c84a439a6a/volumes" Jul 07 15:49:32.419135 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:32.419114 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792f2a8f-9da2-4293-a792-ecc6bf4546bc" path="/var/lib/kubelet/pods/792f2a8f-9da2-4293-a792-ecc6bf4546bc/volumes" Jul 07 15:49:33.320952 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:33.320903 2556 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zs2h4_kuadrant-system_60000847-1264-4ba8-a220-f515604df7b6_0(30f4d80766057a652db6daf5912df7aa269822d8ea0b403a876565e004a77989): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zs2h4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 07 15:49:33.321238 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:33.320989 2556 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zs2h4_kuadrant-system_60000847-1264-4ba8-a220-f515604df7b6_0(30f4d80766057a652db6daf5912df7aa269822d8ea0b403a876565e004a77989): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zs2h4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:34.294940 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.294909 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:34.297175 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:34.297151 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="60000847-1264-4ba8-a220-f515604df7b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:34.330883 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.330857 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:34.332815 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:34.332792 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="60000847-1264-4ba8-a220-f515604df7b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:34.425726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.425694 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume\") pod \"60000847-1264-4ba8-a220-f515604df7b6\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " Jul 07 15:49:34.425884 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.425767 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfdxt\" (UniqueName: \"kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt\") pod \"60000847-1264-4ba8-a220-f515604df7b6\" (UID: \"60000847-1264-4ba8-a220-f515604df7b6\") " Jul 07 15:49:34.425934 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.425897 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "60000847-1264-4ba8-a220-f515604df7b6" (UID: "60000847-1264-4ba8-a220-f515604df7b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:49:34.426039 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.426022 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/60000847-1264-4ba8-a220-f515604df7b6-extensions-socket-volume\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:34.428002 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.427958 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt" (OuterVolumeSpecName: "kube-api-access-zfdxt") pod "60000847-1264-4ba8-a220-f515604df7b6" (UID: "60000847-1264-4ba8-a220-f515604df7b6"). InnerVolumeSpecName "kube-api-access-zfdxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:34.527406 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:34.527373 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfdxt\" (UniqueName: \"kubernetes.io/projected/60000847-1264-4ba8-a220-f515604df7b6-kube-api-access-zfdxt\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:35.298787 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:35.298746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:35.300813 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:35.300780 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="60000847-1264-4ba8-a220-f515604df7b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:35.306672 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:35.306646 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zs2h4\" is forbidden: User \"system:node:ip-10-0-132-99.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-99.ec2.internal' and this object" podUID="60000847-1264-4ba8-a220-f515604df7b6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zs2h4" Jul 07 15:49:36.022651 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:36.022608 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:36.125350 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:36.125316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:36.419035 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:36.418989 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60000847-1264-4ba8-a220-f515604df7b6" path="/var/lib/kubelet/pods/60000847-1264-4ba8-a220-f515604df7b6/volumes" Jul 07 15:49:40.814753 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:40.814717 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:40.921955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:40.921915 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:42.862339 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:42.862309 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:43.293132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.293049 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:43.293132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.293111 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:43.378558 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.378507 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:43.378766 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.378744 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" podUID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" containerName="manager" containerID="cri-o://7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022" gracePeriod=10 Jul 07 15:49:43.434607 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.434583 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:43.546755 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.546727 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:43.609274 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.609249 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:49:43.609618 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.609601 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" containerName="manager" Jul 07 15:49:43.609695 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.609622 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" containerName="manager" Jul 07 15:49:43.609751 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.609715 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f01d9f6-a971-465a-960a-65c84a439a6a" containerName="manager" Jul 07 15:49:43.611680 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.611657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.626801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.626773 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:43.632896 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.632873 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:49:43.701361 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.701330 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume\") pod \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " Jul 07 15:49:43.701522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.701382 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q88bj\" (UniqueName: \"kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj\") pod \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\" (UID: \"c5f50e70-de12-4d6d-8d2a-a9c601c3f847\") " Jul 07 15:49:43.701522 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.701515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.701646 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.701596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87tjq\" (UniqueName: \"kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.701777 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.701754 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c5f50e70-de12-4d6d-8d2a-a9c601c3f847" (UID: "c5f50e70-de12-4d6d-8d2a-a9c601c3f847"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:49:43.703492 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.703470 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj" (OuterVolumeSpecName: "kube-api-access-q88bj") pod "c5f50e70-de12-4d6d-8d2a-a9c601c3f847" (UID: "c5f50e70-de12-4d6d-8d2a-a9c601c3f847"). InnerVolumeSpecName "kube-api-access-q88bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:43.802319 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.802228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.802319 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.802316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87tjq\" (UniqueName: \"kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.802505 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.802356 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-extensions-socket-volume\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:43.802505 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.802366 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q88bj\" (UniqueName: \"kubernetes.io/projected/c5f50e70-de12-4d6d-8d2a-a9c601c3f847-kube-api-access-q88bj\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:43.802610 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.802589 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.813196 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.813174 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87tjq\" (UniqueName: \"kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq\") pod \"kuadrant-operator-controller-manager-86878c769f-jzjq4\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:43.934303 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:43.934263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:44.062110 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.062043 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:49:44.065025 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:49:44.064998 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffef17c_bb0c_4ff0_b1e1_3ee72b615131.slice/crio-8ee47db888f4c22e3054ff68bf1051d5f235032eb7d36a7224be6f0ecdcc9d48 WatchSource:0}: Error finding container 8ee47db888f4c22e3054ff68bf1051d5f235032eb7d36a7224be6f0ecdcc9d48: Status 404 returned error can't find the container with id 8ee47db888f4c22e3054ff68bf1051d5f235032eb7d36a7224be6f0ecdcc9d48 Jul 07 15:49:44.339615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.339515 2556 generic.go:356] "Generic (PLEG): container finished" podID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" containerID="7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022" exitCode=0 Jul 07 15:49:44.339615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.339557 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" Jul 07 15:49:44.339837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.339608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" event={"ID":"c5f50e70-de12-4d6d-8d2a-a9c601c3f847","Type":"ContainerDied","Data":"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022"} Jul 07 15:49:44.339837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.339661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9" event={"ID":"c5f50e70-de12-4d6d-8d2a-a9c601c3f847","Type":"ContainerDied","Data":"20fae244a76f837e52523ba9aff21cab5abe5270f6ed47bcc648c990d5dd3dc4"} Jul 07 15:49:44.339837 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.339685 2556 scope.go:117] "RemoveContainer" containerID="7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022" Jul 07 15:49:44.341487 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.341466 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" event={"ID":"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131","Type":"ContainerStarted","Data":"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110"} Jul 07 15:49:44.341635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.341503 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" event={"ID":"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131","Type":"ContainerStarted","Data":"8ee47db888f4c22e3054ff68bf1051d5f235032eb7d36a7224be6f0ecdcc9d48"} Jul 07 15:49:44.341635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.341603 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:44.349361 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.349347 2556 scope.go:117] "RemoveContainer" containerID="7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022" Jul 07 15:49:44.349622 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:44.349602 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022\": container with ID starting with 7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022 not found: ID does not exist" containerID="7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022" Jul 07 15:49:44.349698 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.349633 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022"} err="failed to get container status \"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022\": rpc error: code = NotFound desc = could not find container \"7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022\": container with ID starting with 7ff7732da924d85ed48a662d1d2f86842c07571bc7d345205cd494e6b33cb022 not found: ID does not exist" Jul 07 15:49:44.365194 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.365145 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" podStartSLOduration=1.365132124 podStartE2EDuration="1.365132124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:44.36359601 +0000 UTC m=+456.516373978" watchObservedRunningTime="2026-07-07 15:49:44.365132124 +0000 UTC m=+456.517910146" Jul 07 15:49:44.383300 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.383276 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:44.389799 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.389779 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7zwc9"] Jul 07 15:49:44.419647 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:44.419620 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" path="/var/lib/kubelet/pods/c5f50e70-de12-4d6d-8d2a-a9c601c3f847/volumes" Jul 07 15:49:47.315490 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:47.315448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:47.465499 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:47.465466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:54.823859 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:54.823824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:54.921425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:54.921393 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:49:55.349456 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.349430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:49:55.416778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.416745 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:55.416953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.416931 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" podUID="7ab347de-07ae-4594-9106-a82b1e8c14da" containerName="manager" containerID="cri-o://30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a" gracePeriod=10 Jul 07 15:49:55.681158 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.681131 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:55.810987 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.810952 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume\") pod \"7ab347de-07ae-4594-9106-a82b1e8c14da\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " Jul 07 15:49:55.811164 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.811067 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf9wb\" (UniqueName: \"kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb\") pod \"7ab347de-07ae-4594-9106-a82b1e8c14da\" (UID: \"7ab347de-07ae-4594-9106-a82b1e8c14da\") " Jul 07 15:49:55.811426 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.811396 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ab347de-07ae-4594-9106-a82b1e8c14da" (UID: "7ab347de-07ae-4594-9106-a82b1e8c14da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:49:55.813269 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.813242 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb" (OuterVolumeSpecName: "kube-api-access-tf9wb") pod "7ab347de-07ae-4594-9106-a82b1e8c14da" (UID: "7ab347de-07ae-4594-9106-a82b1e8c14da"). InnerVolumeSpecName "kube-api-access-tf9wb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:49:55.911756 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.911678 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf9wb\" (UniqueName: \"kubernetes.io/projected/7ab347de-07ae-4594-9106-a82b1e8c14da-kube-api-access-tf9wb\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:55.911756 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:55.911709 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ab347de-07ae-4594-9106-a82b1e8c14da-extensions-socket-volume\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:49:56.398227 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.398183 2556 generic.go:356] "Generic (PLEG): container finished" podID="7ab347de-07ae-4594-9106-a82b1e8c14da" containerID="30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a" exitCode=0 Jul 07 15:49:56.398391 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.398241 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" Jul 07 15:49:56.398391 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.398264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" event={"ID":"7ab347de-07ae-4594-9106-a82b1e8c14da","Type":"ContainerDied","Data":"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a"} Jul 07 15:49:56.398391 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.398313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6" event={"ID":"7ab347de-07ae-4594-9106-a82b1e8c14da","Type":"ContainerDied","Data":"c706c702cd3351b8d2dfc31a93fe5fab047aebc71c6728125a4dcd56e7eced9f"} Jul 07 15:49:56.398391 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.398337 2556 scope.go:117] "RemoveContainer" containerID="30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a" Jul 07 15:49:56.408897 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.408875 2556 scope.go:117] "RemoveContainer" containerID="30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a" Jul 07 15:49:56.409154 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:49:56.409135 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a\": container with ID starting with 30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a not found: ID does not exist" containerID="30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a" Jul 07 15:49:56.409254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.409167 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a"} err="failed to get container status \"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a\": rpc error: code = NotFound desc = could not find container \"30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a\": container with ID starting with 30d2d8c59195a342b0e4bac0661b2d4e1bc3ce176ed3269c502f57476ca03b7a not found: ID does not exist" Jul 07 15:49:56.438789 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.438761 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:56.447111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:56.447085 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zblf6"] Jul 07 15:49:58.418813 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:58.418782 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ab347de-07ae-4594-9106-a82b1e8c14da" path="/var/lib/kubelet/pods/7ab347de-07ae-4594-9106-a82b1e8c14da/volumes" Jul 07 15:49:59.913486 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913452 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh"] Jul 07 15:49:59.913860 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913796 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ab347de-07ae-4594-9106-a82b1e8c14da" containerName="manager" Jul 07 15:49:59.913860 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913808 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ab347de-07ae-4594-9106-a82b1e8c14da" containerName="manager" Jul 07 15:49:59.913860 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913817 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" containerName="manager" Jul 07 15:49:59.913860 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913824 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" containerName="manager" Jul 07 15:49:59.913991 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913879 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ab347de-07ae-4594-9106-a82b1e8c14da" containerName="manager" Jul 07 15:49:59.913991 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.913889 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f50e70-de12-4d6d-8d2a-a9c601c3f847" containerName="manager" Jul 07 15:49:59.964027 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:49:59.963994 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:00.103885 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.103853 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:00.230320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.230239 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh"] Jul 07 15:50:00.230479 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.230346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.233869 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.233853 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jf6dw\"" Jul 07 15:50:00.276271 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.276245 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:00.350435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrfxg\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-kube-api-access-rrfxg\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350796 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.350796 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.350685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.411043 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.411014 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:00.451761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.451724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.451932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.451778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrfxg\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-kube-api-access-rrfxg\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.451932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.451799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.451932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.451820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.451932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.451836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452104 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452104 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452042 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452104 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452282 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452351 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452519 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452497 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452634 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452634 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.452634 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.452599 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.454191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.454165 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.454431 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.454414 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.470815 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.470793 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrfxg\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-kube-api-access-rrfxg\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.473491 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.473473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68f3b63b-0673-4f30-9b33-a6ed2e34bd9a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-chxfh\" (UID: \"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.540621 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.540543 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:00.697763 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.697623 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh"] Jul 07 15:50:00.700602 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:00.700577 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f3b63b_0673_4f30_9b33_a6ed2e34bd9a.slice/crio-2a2c5c4068598582928eb159de35c4b0528022b3f5cc2d3953f5f7c72876b9ce WatchSource:0}: Error finding container 2a2c5c4068598582928eb159de35c4b0528022b3f5cc2d3953f5f7c72876b9ce: Status 404 returned error can't find the container with id 2a2c5c4068598582928eb159de35c4b0528022b3f5cc2d3953f5f7c72876b9ce Jul 07 15:50:00.702653 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.702621 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:50:00.702740 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.702685 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:50:00.702740 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.702713 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:50:00.972194 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:00.972160 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:01.163672 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.163638 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:01.423676 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.423638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" event={"ID":"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a","Type":"ContainerStarted","Data":"64ccc367ae4a9839de1977443ad1d286a08061295f73057e4eee409de8c3c7af"} Jul 07 15:50:01.423887 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.423689 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" event={"ID":"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a","Type":"ContainerStarted","Data":"2a2c5c4068598582928eb159de35c4b0528022b3f5cc2d3953f5f7c72876b9ce"} Jul 07 15:50:01.463615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.463560 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" podStartSLOduration=2.463538607 podStartE2EDuration="2.463538607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:01.461624714 +0000 UTC m=+473.614402680" watchObservedRunningTime="2026-07-07 15:50:01.463538607 +0000 UTC m=+473.616316575" Jul 07 15:50:01.541251 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.541197 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:01.546072 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:01.546040 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:02.427703 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:02.427672 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:02.428727 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:02.428708 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:50:13.837531 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.837501 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:13.840979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.840962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.843307 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.843288 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 15:50:13.844971 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.844948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6vf\" (UniqueName: \"kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.845036 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.845020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.851019 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.850997 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:13.864753 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.864721 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:13.929891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.929859 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:13.946285 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.946260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6vf\" (UniqueName: \"kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.946432 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.946312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.946992 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.946975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.956095 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.956070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6vf\" (UniqueName: \"kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf\") pod \"limitador-limitador-64c94fd64f-d45b6\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:13.981419 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:13.981389 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:14.098666 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.098566 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:14.151274 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.151239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:14.290469 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.290441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:14.292333 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:14.292302 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58251886_572f_49e2_ae46_a2033b3e085e.slice/crio-f1ae6da2880c8a019ea03de89097b6f46cff7a8957b1638a3fe0091d5413f66c WatchSource:0}: Error finding container f1ae6da2880c8a019ea03de89097b6f46cff7a8957b1638a3fe0091d5413f66c: Status 404 returned error can't find the container with id f1ae6da2880c8a019ea03de89097b6f46cff7a8957b1638a3fe0091d5413f66c Jul 07 15:50:14.490929 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.490844 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" event={"ID":"58251886-572f-49e2-ae46-a2033b3e085e","Type":"ContainerStarted","Data":"f1ae6da2880c8a019ea03de89097b6f46cff7a8957b1638a3fe0091d5413f66c"} Jul 07 15:50:14.741852 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.741774 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:14.744581 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.744561 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:14.746867 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.746844 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-596nt\"" Jul 07 15:50:14.753002 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.752901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6xxz\" (UniqueName: \"kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz\") pod \"authorino-58cd955675-8bj2z\" (UID: \"2f74af4d-8dd8-4310-a3a9-ce05690aff29\") " pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:14.761170 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.761146 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:14.805688 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.805646 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:14.854112 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.854076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6xxz\" (UniqueName: \"kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz\") pod \"authorino-58cd955675-8bj2z\" (UID: \"2f74af4d-8dd8-4310-a3a9-ce05690aff29\") " pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:14.864475 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.864447 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6xxz\" (UniqueName: \"kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz\") pod \"authorino-58cd955675-8bj2z\" (UID: \"2f74af4d-8dd8-4310-a3a9-ce05690aff29\") " pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:14.944041 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:14.944004 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:15.003632 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.002285 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:15.005927 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.005902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:15.023089 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.023064 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:15.056640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.056511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px5k8\" (UniqueName: \"kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8\") pod \"authorino-75d556bd77-58bdb\" (UID: \"442d686a-36a1-4f49-932e-4486baedbee0\") " pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:15.057132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.056877 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:15.157254 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.157217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px5k8\" (UniqueName: \"kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8\") pod \"authorino-75d556bd77-58bdb\" (UID: \"442d686a-36a1-4f49-932e-4486baedbee0\") " pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:15.168656 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.168513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px5k8\" (UniqueName: \"kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8\") pod \"authorino-75d556bd77-58bdb\" (UID: \"442d686a-36a1-4f49-932e-4486baedbee0\") " pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:15.263594 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.263556 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:15.266741 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:15.266708 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f74af4d_8dd8_4310_a3a9_ce05690aff29.slice/crio-e289edebfc0ae9f429b4e47924f765215d9e7d56149e09c344956d9952d5b521 WatchSource:0}: Error finding container e289edebfc0ae9f429b4e47924f765215d9e7d56149e09c344956d9952d5b521: Status 404 returned error can't find the container with id e289edebfc0ae9f429b4e47924f765215d9e7d56149e09c344956d9952d5b521 Jul 07 15:50:15.321754 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.321724 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:15.479367 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.479334 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:15.482971 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:15.482943 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod442d686a_36a1_4f49_932e_4486baedbee0.slice/crio-a0e1155413066efc5b99b43810413824752ce0aee3b6682a4b05ae856be93b71 WatchSource:0}: Error finding container a0e1155413066efc5b99b43810413824752ce0aee3b6682a4b05ae856be93b71: Status 404 returned error can't find the container with id a0e1155413066efc5b99b43810413824752ce0aee3b6682a4b05ae856be93b71 Jul 07 15:50:15.497727 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.497690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8bj2z" event={"ID":"2f74af4d-8dd8-4310-a3a9-ce05690aff29","Type":"ContainerStarted","Data":"e289edebfc0ae9f429b4e47924f765215d9e7d56149e09c344956d9952d5b521"} Jul 07 15:50:15.498949 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:15.498913 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58bdb" event={"ID":"442d686a-36a1-4f49-932e-4486baedbee0","Type":"ContainerStarted","Data":"a0e1155413066efc5b99b43810413824752ce0aee3b6682a4b05ae856be93b71"} Jul 07 15:50:19.522659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.522621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58bdb" event={"ID":"442d686a-36a1-4f49-932e-4486baedbee0","Type":"ContainerStarted","Data":"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f"} Jul 07 15:50:19.524150 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.524124 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" event={"ID":"58251886-572f-49e2-ae46-a2033b3e085e","Type":"ContainerStarted","Data":"5cbb4ac057518116c91bf6b62a4accc71f9e27fed7385e0874346901839b257c"} Jul 07 15:50:19.524285 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.524171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:19.525481 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.525460 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8bj2z" event={"ID":"2f74af4d-8dd8-4310-a3a9-ce05690aff29","Type":"ContainerStarted","Data":"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a"} Jul 07 15:50:19.541375 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.541328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-58bdb" podStartSLOduration=2.056720115 podStartE2EDuration="5.541310388s" totalImagesPullingTime="3.484590273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:19.539944644 +0000 UTC m=+491.692722611" watchObservedRunningTime="2026-07-07 15:50:19.541310388 +0000 UTC m=+491.694088353" Jul 07 15:50:19.564183 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.564133 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8bj2z" podStartSLOduration=1.863240802 podStartE2EDuration="5.564111264s" totalImagesPullingTime="3.700870462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:19.562943783 +0000 UTC m=+491.715721761" watchObservedRunningTime="2026-07-07 15:50:19.564111264 +0000 UTC m=+491.716889230" Jul 07 15:50:19.579119 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.579086 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:19.594493 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:19.594436 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" podStartSLOduration=1.908766944 podStartE2EDuration="6.594418681s" totalImagesPullingTime="4.685651737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:19.593331103 +0000 UTC m=+491.746109070" watchObservedRunningTime="2026-07-07 15:50:19.594418681 +0000 UTC m=+491.747196654" Jul 07 15:50:21.535357 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:21.535313 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8bj2z" podUID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" containerName="authorino" containerID="cri-o://06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a" gracePeriod=30 Jul 07 15:50:21.779698 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:21.779674 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:21.817924 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:21.817895 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6xxz\" (UniqueName: \"kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz\") pod \"2f74af4d-8dd8-4310-a3a9-ce05690aff29\" (UID: \"2f74af4d-8dd8-4310-a3a9-ce05690aff29\") " Jul 07 15:50:21.820038 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:21.820016 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz" (OuterVolumeSpecName: "kube-api-access-w6xxz") pod "2f74af4d-8dd8-4310-a3a9-ce05690aff29" (UID: "2f74af4d-8dd8-4310-a3a9-ce05690aff29"). InnerVolumeSpecName "kube-api-access-w6xxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:50:21.918757 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:21.918720 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6xxz\" (UniqueName: \"kubernetes.io/projected/2f74af4d-8dd8-4310-a3a9-ce05690aff29-kube-api-access-w6xxz\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:22.541055 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.541023 2556 generic.go:356] "Generic (PLEG): container finished" podID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" containerID="06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a" exitCode=0 Jul 07 15:50:22.541501 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.541062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8bj2z" event={"ID":"2f74af4d-8dd8-4310-a3a9-ce05690aff29","Type":"ContainerDied","Data":"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a"} Jul 07 15:50:22.541501 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.541065 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8bj2z" Jul 07 15:50:22.541501 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.541091 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8bj2z" event={"ID":"2f74af4d-8dd8-4310-a3a9-ce05690aff29","Type":"ContainerDied","Data":"e289edebfc0ae9f429b4e47924f765215d9e7d56149e09c344956d9952d5b521"} Jul 07 15:50:22.541501 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.541127 2556 scope.go:117] "RemoveContainer" containerID="06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a" Jul 07 15:50:22.549795 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.549777 2556 scope.go:117] "RemoveContainer" containerID="06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a" Jul 07 15:50:22.550046 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:22.550018 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a\": container with ID starting with 06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a not found: ID does not exist" containerID="06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a" Jul 07 15:50:22.550119 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.550044 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a"} err="failed to get container status \"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a\": rpc error: code = NotFound desc = could not find container \"06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a\": container with ID starting with 06bf30592bd85ff3f42db9eb075197e7ca8da2d8f085dd9b17f9977ef927d44a not found: ID does not exist" Jul 07 15:50:22.558905 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.558881 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:22.563873 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:22.563854 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8bj2z"] Jul 07 15:50:24.418929 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:24.418896 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" path="/var/lib/kubelet/pods/2f74af4d-8dd8-4310-a3a9-ce05690aff29/volumes" Jul 07 15:50:29.049253 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:29.049222 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:29.049685 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:29.049411 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" podUID="58251886-572f-49e2-ae46-a2033b3e085e" containerName="limitador" containerID="cri-o://5cbb4ac057518116c91bf6b62a4accc71f9e27fed7385e0874346901839b257c" gracePeriod=30 Jul 07 15:50:29.050115 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:29.050097 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:29.579276 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:29.579241 2556 generic.go:356] "Generic (PLEG): container finished" podID="58251886-572f-49e2-ae46-a2033b3e085e" containerID="5cbb4ac057518116c91bf6b62a4accc71f9e27fed7385e0874346901839b257c" exitCode=0 Jul 07 15:50:29.579276 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:29.579280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" event={"ID":"58251886-572f-49e2-ae46-a2033b3e085e","Type":"ContainerDied","Data":"5cbb4ac057518116c91bf6b62a4accc71f9e27fed7385e0874346901839b257c"} Jul 07 15:50:30.016762 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.016740 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:30.089862 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.089835 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file\") pod \"58251886-572f-49e2-ae46-a2033b3e085e\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " Jul 07 15:50:30.090222 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.089917 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp6vf\" (UniqueName: \"kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf\") pod \"58251886-572f-49e2-ae46-a2033b3e085e\" (UID: \"58251886-572f-49e2-ae46-a2033b3e085e\") " Jul 07 15:50:30.090269 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.090224 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file" (OuterVolumeSpecName: "config-file") pod "58251886-572f-49e2-ae46-a2033b3e085e" (UID: "58251886-572f-49e2-ae46-a2033b3e085e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 15:50:30.091959 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.091936 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf" (OuterVolumeSpecName: "kube-api-access-tp6vf") pod "58251886-572f-49e2-ae46-a2033b3e085e" (UID: "58251886-572f-49e2-ae46-a2033b3e085e"). InnerVolumeSpecName "kube-api-access-tp6vf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:50:30.190791 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.190696 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58251886-572f-49e2-ae46-a2033b3e085e-config-file\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:30.190791 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.190734 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp6vf\" (UniqueName: \"kubernetes.io/projected/58251886-572f-49e2-ae46-a2033b3e085e-kube-api-access-tp6vf\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:30.584720 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.584695 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" Jul 07 15:50:30.584720 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.584701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-d45b6" event={"ID":"58251886-572f-49e2-ae46-a2033b3e085e","Type":"ContainerDied","Data":"f1ae6da2880c8a019ea03de89097b6f46cff7a8957b1638a3fe0091d5413f66c"} Jul 07 15:50:30.584935 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.584755 2556 scope.go:117] "RemoveContainer" containerID="5cbb4ac057518116c91bf6b62a4accc71f9e27fed7385e0874346901839b257c" Jul 07 15:50:30.601286 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.601261 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:30.609900 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:30.609880 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-d45b6"] Jul 07 15:50:32.419042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:32.419013 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58251886-572f-49e2-ae46-a2033b3e085e" path="/var/lib/kubelet/pods/58251886-572f-49e2-ae46-a2033b3e085e/volumes" Jul 07 15:50:34.491870 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.491826 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-mjbm2"] Jul 07 15:50:34.492351 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492287 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" containerName="authorino" Jul 07 15:50:34.492351 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492307 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" containerName="authorino" Jul 07 15:50:34.492351 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492334 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58251886-572f-49e2-ae46-a2033b3e085e" containerName="limitador" Jul 07 15:50:34.492351 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492342 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="58251886-572f-49e2-ae46-a2033b3e085e" containerName="limitador" Jul 07 15:50:34.492564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492457 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="58251886-572f-49e2-ae46-a2033b3e085e" containerName="limitador" Jul 07 15:50:34.492564 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.492470 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f74af4d-8dd8-4310-a3a9-ce05690aff29" containerName="authorino" Jul 07 15:50:34.494905 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.494885 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.496992 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.496971 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fw87t\"" Jul 07 15:50:34.497113 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.496976 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 15:50:34.504362 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.504339 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mjbm2"] Jul 07 15:50:34.560345 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.560312 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:34.627146 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.627114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-data\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.627146 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.627148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fpw4\" (UniqueName: \"kubernetes.io/projected/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-kube-api-access-9fpw4\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.728289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.728256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-data\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.728289 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.728294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fpw4\" (UniqueName: \"kubernetes.io/projected/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-kube-api-access-9fpw4\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.728657 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.728638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-data\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.740948 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.740921 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fpw4\" (UniqueName: \"kubernetes.io/projected/071af4ee-328e-4e73-a8a3-42a5fa6c6d88-kube-api-access-9fpw4\") pod \"postgres-69fb4594cf-mjbm2\" (UID: \"071af4ee-328e-4e73-a8a3-42a5fa6c6d88\") " pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.806144 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.806116 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:34.936386 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:34.936364 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mjbm2"] Jul 07 15:50:34.938712 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:34.938687 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071af4ee_328e_4e73_a8a3_42a5fa6c6d88.slice/crio-69cca49acf4e059b7b15373ac0a9bc2bf95f5539aab866de8f61e068211592cf WatchSource:0}: Error finding container 69cca49acf4e059b7b15373ac0a9bc2bf95f5539aab866de8f61e068211592cf: Status 404 returned error can't find the container with id 69cca49acf4e059b7b15373ac0a9bc2bf95f5539aab866de8f61e068211592cf Jul 07 15:50:35.608948 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:35.608911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mjbm2" event={"ID":"071af4ee-328e-4e73-a8a3-42a5fa6c6d88","Type":"ContainerStarted","Data":"69cca49acf4e059b7b15373ac0a9bc2bf95f5539aab866de8f61e068211592cf"} Jul 07 15:50:39.797315 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:39.797283 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:39.899568 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:39.899529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:40.641317 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:40.641264 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mjbm2" event={"ID":"071af4ee-328e-4e73-a8a3-42a5fa6c6d88","Type":"ContainerStarted","Data":"ff5686e8265855205f3aa36237c0ae4a4d00263761ca2a627786369589610827"} Jul 07 15:50:40.641521 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:40.641448 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:40.667871 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:40.667824 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-mjbm2" podStartSLOduration=1.751167663 podStartE2EDuration="6.66780578s" totalImagesPullingTime="4.916638117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:40.666832745 +0000 UTC m=+512.819610711" watchObservedRunningTime="2026-07-07 15:50:40.66780578 +0000 UTC m=+512.820583750" Jul 07 15:50:46.675767 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:46.675731 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-mjbm2" Jul 07 15:50:47.116147 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.116117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:47.305296 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.305258 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxdr"] Jul 07 15:50:47.311216 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.311191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.320267 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.320241 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxdr"] Jul 07 15:50:47.450112 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.450028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvbk\" (UniqueName: \"kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk\") pod \"authorino-5d4b67c446-kfxdr\" (UID: \"8480222c-10d2-40be-8a52-85a90ee73ef0\") " pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.549508 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.549471 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxdr"] Jul 07 15:50:47.549777 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:47.549757 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9fvbk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-kfxdr" podUID="8480222c-10d2-40be-8a52-85a90ee73ef0" Jul 07 15:50:47.550888 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.550865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvbk\" (UniqueName: \"kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk\") pod \"authorino-5d4b67c446-kfxdr\" (UID: \"8480222c-10d2-40be-8a52-85a90ee73ef0\") " pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.561459 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.561429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvbk\" (UniqueName: \"kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk\") pod \"authorino-5d4b67c446-kfxdr\" (UID: \"8480222c-10d2-40be-8a52-85a90ee73ef0\") " pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.595660 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.595630 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:47.597966 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.597949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:47.613951 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.613925 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:47.669082 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.669038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:47.672134 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.672111 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.677625 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.677605 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:47.753487 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.753412 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfbz\" (UniqueName: \"kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz\") pod \"authorino-84fd5b495f-dvkbk\" (UID: \"d184d61b-3c94-4925-a478-4672f5bb3531\") " pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:47.854197 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.854164 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvbk\" (UniqueName: \"kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk\") pod \"8480222c-10d2-40be-8a52-85a90ee73ef0\" (UID: \"8480222c-10d2-40be-8a52-85a90ee73ef0\") " Jul 07 15:50:47.854384 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.854368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfbz\" (UniqueName: \"kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz\") pod \"authorino-84fd5b495f-dvkbk\" (UID: \"d184d61b-3c94-4925-a478-4672f5bb3531\") " pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:47.856171 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.856148 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk" (OuterVolumeSpecName: "kube-api-access-9fvbk") pod "8480222c-10d2-40be-8a52-85a90ee73ef0" (UID: "8480222c-10d2-40be-8a52-85a90ee73ef0"). InnerVolumeSpecName "kube-api-access-9fvbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:50:47.863768 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.863736 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfbz\" (UniqueName: \"kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz\") pod \"authorino-84fd5b495f-dvkbk\" (UID: \"d184d61b-3c94-4925-a478-4672f5bb3531\") " pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:47.913638 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.913609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:47.920587 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.920562 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:47.955617 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.955503 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvbk\" (UniqueName: \"kubernetes.io/projected/8480222c-10d2-40be-8a52-85a90ee73ef0-kube-api-access-9fvbk\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:47.957345 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.957318 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:50:47.960995 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.960383 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:47.964140 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.963933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 15:50:47.978928 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:47.978898 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:50:48.053010 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.052832 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:48.055653 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:48.055628 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd184d61b_3c94_4925_a478_4672f5bb3531.slice/crio-42dee559982ec266b733b2ece18282e6d2fe4ee6a6f2694e86f32b031e8da008 WatchSource:0}: Error finding container 42dee559982ec266b733b2ece18282e6d2fe4ee6a6f2694e86f32b031e8da008: Status 404 returned error can't find the container with id 42dee559982ec266b733b2ece18282e6d2fe4ee6a6f2694e86f32b031e8da008 Jul 07 15:50:48.055922 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.055903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.056074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.056041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5s2\" (UniqueName: \"kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.157157 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.157122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5s2\" (UniqueName: \"kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.157365 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.157166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.159586 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.159559 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.166724 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.166702 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5s2\" (UniqueName: \"kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2\") pod \"authorino-9f5f54f5f-jm4pp\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.274167 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.274139 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:50:48.411326 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.411296 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:50:48.413807 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:48.413780 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod109a026c_e5b5_403e_8166_c28f9b99f3b3.slice/crio-0d60493f68a22f02e75e721bdbe79ce69770ce6f2c47bdec6481dadc58865b02 WatchSource:0}: Error finding container 0d60493f68a22f02e75e721bdbe79ce69770ce6f2c47bdec6481dadc58865b02: Status 404 returned error can't find the container with id 0d60493f68a22f02e75e721bdbe79ce69770ce6f2c47bdec6481dadc58865b02 Jul 07 15:50:48.681144 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.681102 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" event={"ID":"d184d61b-3c94-4925-a478-4672f5bb3531","Type":"ContainerStarted","Data":"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064"} Jul 07 15:50:48.681144 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.681138 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" podUID="d184d61b-3c94-4925-a478-4672f5bb3531" containerName="authorino" containerID="cri-o://361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064" gracePeriod=30 Jul 07 15:50:48.681705 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.681154 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" event={"ID":"d184d61b-3c94-4925-a478-4672f5bb3531","Type":"ContainerStarted","Data":"42dee559982ec266b733b2ece18282e6d2fe4ee6a6f2694e86f32b031e8da008"} Jul 07 15:50:48.682615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.682580 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" event={"ID":"109a026c-e5b5-403e-8166-c28f9b99f3b3","Type":"ContainerStarted","Data":"0d60493f68a22f02e75e721bdbe79ce69770ce6f2c47bdec6481dadc58865b02"} Jul 07 15:50:48.682615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.682610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kfxdr" Jul 07 15:50:48.699020 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.698968 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" podStartSLOduration=1.217424825 podStartE2EDuration="1.69895159s" totalImagesPullingTime="481.526765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:48.698493608 +0000 UTC m=+520.851271573" watchObservedRunningTime="2026-07-07 15:50:48.69895159 +0000 UTC m=+520.851729556" Jul 07 15:50:48.727466 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.727439 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxdr"] Jul 07 15:50:48.732363 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.732337 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kfxdr"] Jul 07 15:50:48.925180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:48.925148 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:49.065328 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.065280 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgfbz\" (UniqueName: \"kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz\") pod \"d184d61b-3c94-4925-a478-4672f5bb3531\" (UID: \"d184d61b-3c94-4925-a478-4672f5bb3531\") " Jul 07 15:50:49.067385 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.067354 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz" (OuterVolumeSpecName: "kube-api-access-hgfbz") pod "d184d61b-3c94-4925-a478-4672f5bb3531" (UID: "d184d61b-3c94-4925-a478-4672f5bb3531"). InnerVolumeSpecName "kube-api-access-hgfbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:50:49.166163 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.166076 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgfbz\" (UniqueName: \"kubernetes.io/projected/d184d61b-3c94-4925-a478-4672f5bb3531-kube-api-access-hgfbz\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:49.689531 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.689498 2556 generic.go:356] "Generic (PLEG): container finished" podID="d184d61b-3c94-4925-a478-4672f5bb3531" containerID="361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064" exitCode=0 Jul 07 15:50:49.689988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.689539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" event={"ID":"d184d61b-3c94-4925-a478-4672f5bb3531","Type":"ContainerDied","Data":"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064"} Jul 07 15:50:49.689988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.689551 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" Jul 07 15:50:49.689988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.689578 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fd5b495f-dvkbk" event={"ID":"d184d61b-3c94-4925-a478-4672f5bb3531","Type":"ContainerDied","Data":"42dee559982ec266b733b2ece18282e6d2fe4ee6a6f2694e86f32b031e8da008"} Jul 07 15:50:49.689988 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.689595 2556 scope.go:117] "RemoveContainer" containerID="361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064" Jul 07 15:50:49.691270 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.691243 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" event={"ID":"109a026c-e5b5-403e-8166-c28f9b99f3b3","Type":"ContainerStarted","Data":"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6"} Jul 07 15:50:49.698223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.698192 2556 scope.go:117] "RemoveContainer" containerID="361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064" Jul 07 15:50:49.698492 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:49.698472 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064\": container with ID starting with 361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064 not found: ID does not exist" containerID="361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064" Jul 07 15:50:49.698602 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.698498 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064"} err="failed to get container status \"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064\": rpc error: code = NotFound desc = could not find container \"361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064\": container with ID starting with 361628cab76bdbfa44ce8487d969358e102a81022f9fa92e0b2fdc366c265064 not found: ID does not exist" Jul 07 15:50:49.720239 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.720178 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" podStartSLOduration=2.335074981 podStartE2EDuration="2.720161657s" totalImagesPullingTime="385.086676ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:49.718776697 +0000 UTC m=+521.871554662" watchObservedRunningTime="2026-07-07 15:50:49.720161657 +0000 UTC m=+521.872939623" Jul 07 15:50:49.738768 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.738740 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:49.751377 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.751352 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84fd5b495f-dvkbk"] Jul 07 15:50:49.759085 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.759059 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:49.759311 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:49.759286 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-58bdb" podUID="442d686a-36a1-4f49-932e-4486baedbee0" containerName="authorino" containerID="cri-o://5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f" gracePeriod=30 Jul 07 15:50:50.010899 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.010873 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:50.175476 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.175382 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px5k8\" (UniqueName: \"kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8\") pod \"442d686a-36a1-4f49-932e-4486baedbee0\" (UID: \"442d686a-36a1-4f49-932e-4486baedbee0\") " Jul 07 15:50:50.177498 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.177449 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8" (OuterVolumeSpecName: "kube-api-access-px5k8") pod "442d686a-36a1-4f49-932e-4486baedbee0" (UID: "442d686a-36a1-4f49-932e-4486baedbee0"). InnerVolumeSpecName "kube-api-access-px5k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:50:50.276219 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.276171 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px5k8\" (UniqueName: \"kubernetes.io/projected/442d686a-36a1-4f49-932e-4486baedbee0-kube-api-access-px5k8\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:50:50.419659 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.419625 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8480222c-10d2-40be-8a52-85a90ee73ef0" path="/var/lib/kubelet/pods/8480222c-10d2-40be-8a52-85a90ee73ef0/volumes" Jul 07 15:50:50.419889 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.419877 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d184d61b-3c94-4925-a478-4672f5bb3531" path="/var/lib/kubelet/pods/d184d61b-3c94-4925-a478-4672f5bb3531/volumes" Jul 07 15:50:50.697761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.697674 2556 generic.go:356] "Generic (PLEG): container finished" podID="442d686a-36a1-4f49-932e-4486baedbee0" containerID="5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f" exitCode=0 Jul 07 15:50:50.697761 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.697738 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58bdb" Jul 07 15:50:50.698241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.697769 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58bdb" event={"ID":"442d686a-36a1-4f49-932e-4486baedbee0","Type":"ContainerDied","Data":"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f"} Jul 07 15:50:50.698241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.697813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58bdb" event={"ID":"442d686a-36a1-4f49-932e-4486baedbee0","Type":"ContainerDied","Data":"a0e1155413066efc5b99b43810413824752ce0aee3b6682a4b05ae856be93b71"} Jul 07 15:50:50.698241 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.697831 2556 scope.go:117] "RemoveContainer" containerID="5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f" Jul 07 15:50:50.706195 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.706176 2556 scope.go:117] "RemoveContainer" containerID="5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f" Jul 07 15:50:50.706488 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:50.706464 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f\": container with ID starting with 5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f not found: ID does not exist" containerID="5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f" Jul 07 15:50:50.706558 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.706498 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f"} err="failed to get container status \"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f\": rpc error: code = NotFound desc = could not find container \"5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f\": container with ID starting with 5cc276f8d30fe1012776ba5349d09a20b860a6a386897534f1e89374879bde8f not found: ID does not exist" Jul 07 15:50:50.716514 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.716495 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:50.723776 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:50.723742 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58bdb"] Jul 07 15:50:52.419267 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:52.419239 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="442d686a-36a1-4f49-932e-4486baedbee0" path="/var/lib/kubelet/pods/442d686a-36a1-4f49-932e-4486baedbee0/volumes" Jul 07 15:50:54.398473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.398437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:54.444149 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444119 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:50:54.444464 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444450 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442d686a-36a1-4f49-932e-4486baedbee0" containerName="authorino" Jul 07 15:50:54.444512 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444465 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="442d686a-36a1-4f49-932e-4486baedbee0" containerName="authorino" Jul 07 15:50:54.444512 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444482 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d184d61b-3c94-4925-a478-4672f5bb3531" containerName="authorino" Jul 07 15:50:54.444512 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444487 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d184d61b-3c94-4925-a478-4672f5bb3531" containerName="authorino" Jul 07 15:50:54.444601 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444547 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="442d686a-36a1-4f49-932e-4486baedbee0" containerName="authorino" Jul 07 15:50:54.444601 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.444554 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d184d61b-3c94-4925-a478-4672f5bb3531" containerName="authorino" Jul 07 15:50:54.448995 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.448975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.456094 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.456061 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 15:50:54.456270 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.456066 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-knb7s\"" Jul 07 15:50:54.456582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.456563 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 15:50:54.467107 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.467080 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:50:54.592550 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.592513 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:54.615725 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.615691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.615919 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.615748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjmvw\" (UniqueName: \"kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.678141 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.678065 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:50:54.680451 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.680434 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.697808 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.697785 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:50:54.716302 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.716276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.716418 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.716322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjmvw\" (UniqueName: \"kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.716484 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:54.716444 2556 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 15:50:54.716545 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:50:54.716529 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert podName:ce6cb52c-b526-4f07-a934-a6c6c451284a nodeName:}" failed. No retries permitted until 2026-07-07 15:50:55.216502782 +0000 UTC m=+527.369280777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert") pod "maas-controller-77887d695c-hrjgr" (UID: "ce6cb52c-b526-4f07-a934-a6c6c451284a") : secret "maas-controller-webhook-cert" not found Jul 07 15:50:54.733228 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.733172 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjmvw\" (UniqueName: \"kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:54.747911 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.747884 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:54.817180 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.817149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5ddw\" (UniqueName: \"kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.817353 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.817248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.896550 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.896516 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:54.918481 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.918449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.918624 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.918525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5ddw\" (UniqueName: \"kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.920787 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.920767 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.935189 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.935129 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5ddw\" (UniqueName: \"kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw\") pod \"maas-controller-7b74d8f87b-rl5t4\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:54.990295 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:54.990267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:55.129518 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.129350 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:50:55.131792 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:55.131760 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842bf884_39a8_4a0a_904e_cfa1ca7fe97f.slice/crio-762ccd44ea960594f4e10c85dd1602a6d53fc89f5fc36cc80f1634a5e59d302c WatchSource:0}: Error finding container 762ccd44ea960594f4e10c85dd1602a6d53fc89f5fc36cc80f1634a5e59d302c: Status 404 returned error can't find the container with id 762ccd44ea960594f4e10c85dd1602a6d53fc89f5fc36cc80f1634a5e59d302c Jul 07 15:50:55.221304 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.221195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:55.223528 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.223507 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") pod \"maas-controller-77887d695c-hrjgr\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:55.358980 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.358946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:55.495694 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.495618 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:50:55.498476 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:50:55.498443 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6cb52c_b526_4f07_a934_a6c6c451284a.slice/crio-7415f843db1e318c786f82dc46ffc5a901781042efdd646da8e764228a70f254 WatchSource:0}: Error finding container 7415f843db1e318c786f82dc46ffc5a901781042efdd646da8e764228a70f254: Status 404 returned error can't find the container with id 7415f843db1e318c786f82dc46ffc5a901781042efdd646da8e764228a70f254 Jul 07 15:50:55.724413 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.724373 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" event={"ID":"842bf884-39a8-4a0a-904e-cfa1ca7fe97f","Type":"ContainerStarted","Data":"762ccd44ea960594f4e10c85dd1602a6d53fc89f5fc36cc80f1634a5e59d302c"} Jul 07 15:50:55.725816 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:55.725791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77887d695c-hrjgr" event={"ID":"ce6cb52c-b526-4f07-a934-a6c6c451284a","Type":"ContainerStarted","Data":"7415f843db1e318c786f82dc46ffc5a901781042efdd646da8e764228a70f254"} Jul 07 15:50:57.902534 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:57.902500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:57.999762 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:57.999649 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:50:58.743629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.743587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77887d695c-hrjgr" event={"ID":"ce6cb52c-b526-4f07-a934-a6c6c451284a","Type":"ContainerStarted","Data":"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf"} Jul 07 15:50:58.743798 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.743728 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:50:58.745069 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.745048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" event={"ID":"842bf884-39a8-4a0a-904e-cfa1ca7fe97f","Type":"ContainerStarted","Data":"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8"} Jul 07 15:50:58.745181 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.745166 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:50:58.769708 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.769669 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77887d695c-hrjgr" podStartSLOduration=2.571692192 podStartE2EDuration="4.769655667s" totalImagesPullingTime="2.197963475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:58.76765408 +0000 UTC m=+530.920432036" watchObservedRunningTime="2026-07-07 15:50:58.769655667 +0000 UTC m=+530.922433650" Jul 07 15:50:58.796436 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:50:58.796385 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" podStartSLOduration=2.225639316 podStartE2EDuration="4.79637311s" totalImagesPullingTime="2.570733794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:58.796098839 +0000 UTC m=+530.948876805" watchObservedRunningTime="2026-07-07 15:50:58.79637311 +0000 UTC m=+530.949151082" Jul 07 15:51:09.754525 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:09.754495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:51:09.755006 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:09.754583 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:51:09.831567 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:09.831534 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:51:09.831756 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:09.831721 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77887d695c-hrjgr" podUID="ce6cb52c-b526-4f07-a934-a6c6c451284a" containerName="manager" containerID="cri-o://df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf" gracePeriod=30 Jul 07 15:51:10.135406 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.135371 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:51:10.241473 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.241441 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjmvw\" (UniqueName: \"kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw\") pod \"ce6cb52c-b526-4f07-a934-a6c6c451284a\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " Jul 07 15:51:10.241649 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.241500 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") pod \"ce6cb52c-b526-4f07-a934-a6c6c451284a\" (UID: \"ce6cb52c-b526-4f07-a934-a6c6c451284a\") " Jul 07 15:51:10.243686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.243655 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw" (OuterVolumeSpecName: "kube-api-access-vjmvw") pod "ce6cb52c-b526-4f07-a934-a6c6c451284a" (UID: "ce6cb52c-b526-4f07-a934-a6c6c451284a"). InnerVolumeSpecName "kube-api-access-vjmvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:51:10.243902 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.243773 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ce6cb52c-b526-4f07-a934-a6c6c451284a" (UID: "ce6cb52c-b526-4f07-a934-a6c6c451284a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:51:10.342503 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.342466 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjmvw\" (UniqueName: \"kubernetes.io/projected/ce6cb52c-b526-4f07-a934-a6c6c451284a-kube-api-access-vjmvw\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:51:10.342503 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.342499 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ce6cb52c-b526-4f07-a934-a6c6c451284a-webhook-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:51:10.803248 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.803199 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce6cb52c-b526-4f07-a934-a6c6c451284a" containerID="df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf" exitCode=0 Jul 07 15:51:10.803686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.803257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77887d695c-hrjgr" event={"ID":"ce6cb52c-b526-4f07-a934-a6c6c451284a","Type":"ContainerDied","Data":"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf"} Jul 07 15:51:10.803686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.803298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77887d695c-hrjgr" event={"ID":"ce6cb52c-b526-4f07-a934-a6c6c451284a","Type":"ContainerDied","Data":"7415f843db1e318c786f82dc46ffc5a901781042efdd646da8e764228a70f254"} Jul 07 15:51:10.803686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.803318 2556 scope.go:117] "RemoveContainer" containerID="df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf" Jul 07 15:51:10.803686 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.803259 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77887d695c-hrjgr" Jul 07 15:51:10.812032 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.812015 2556 scope.go:117] "RemoveContainer" containerID="df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf" Jul 07 15:51:10.812288 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:51:10.812269 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf\": container with ID starting with df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf not found: ID does not exist" containerID="df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf" Jul 07 15:51:10.812333 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.812296 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf"} err="failed to get container status \"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf\": rpc error: code = NotFound desc = could not find container \"df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf\": container with ID starting with df4d6d2e2bd82ac4095f16be7ed29432adc1a3dd5e32f44285d54e6062ea1bbf not found: ID does not exist" Jul 07 15:51:10.820875 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.820852 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:51:10.826028 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:10.826008 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77887d695c-hrjgr"] Jul 07 15:51:12.419084 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:12.419048 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6cb52c-b526-4f07-a934-a6c6c451284a" path="/var/lib/kubelet/pods/ce6cb52c-b526-4f07-a934-a6c6c451284a/volumes" Jul 07 15:51:30.393372 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.393338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:30.798453 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.798423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:30.829776 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.829742 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7446dd9f78-rr9g6"] Jul 07 15:51:30.830085 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.830073 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6cb52c-b526-4f07-a934-a6c6c451284a" containerName="manager" Jul 07 15:51:30.830134 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.830086 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6cb52c-b526-4f07-a934-a6c6c451284a" containerName="manager" Jul 07 15:51:30.830169 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.830156 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6cb52c-b526-4f07-a934-a6c6c451284a" containerName="manager" Jul 07 15:51:30.837965 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.837945 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:30.839981 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.839957 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 15:51:30.850438 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.850413 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7446dd9f78-rr9g6"] Jul 07 15:51:30.918411 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.918376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9t6\" (UniqueName: \"kubernetes.io/projected/0af38e77-fb9c-46fa-9717-5604d30a7d3f-kube-api-access-5x9t6\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:30.918603 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.918441 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:30.918603 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:30.918510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0af38e77-fb9c-46fa-9717-5604d30a7d3f-openshift-service-ca\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.019832 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.019791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9t6\" (UniqueName: \"kubernetes.io/projected/0af38e77-fb9c-46fa-9717-5604d30a7d3f-kube-api-access-5x9t6\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.020027 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.019869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.020027 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.019895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0af38e77-fb9c-46fa-9717-5604d30a7d3f-openshift-service-ca\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.020027 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:51:31.020008 2556 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 07 15:51:31.020192 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:51:31.020079 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls podName:0af38e77-fb9c-46fa-9717-5604d30a7d3f nodeName:}" failed. No retries permitted until 2026-07-07 15:51:31.520064934 +0000 UTC m=+563.672842878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls") pod "maas-api-7446dd9f78-rr9g6" (UID: "0af38e77-fb9c-46fa-9717-5604d30a7d3f") : secret "maas-api-serving-cert" not found Jul 07 15:51:31.020518 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.020501 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0af38e77-fb9c-46fa-9717-5604d30a7d3f-openshift-service-ca\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.031151 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.031126 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9t6\" (UniqueName: \"kubernetes.io/projected/0af38e77-fb9c-46fa-9717-5604d30a7d3f-kube-api-access-5x9t6\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.099887 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.099782 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:31.321120 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.321086 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:31.418056 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.417979 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:31.435952 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.435926 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wdtdx"] Jul 07 15:51:31.438506 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.438487 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.440615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.440597 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2x5np\"" Jul 07 15:51:31.440615 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.440598 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 15:51:31.451012 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.450989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wdtdx"] Jul 07 15:51:31.455424 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.455399 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-hn2wf"] Jul 07 15:51:31.472755 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.472719 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-hn2wf"] Jul 07 15:51:31.473475 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.472837 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.524361 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.524323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x96x8\" (UniqueName: \"kubernetes.io/projected/5192747a-dade-4419-9409-470383b39b37-kube-api-access-x96x8\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.524562 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.524380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5192747a-dade-4419-9409-470383b39b37-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.524562 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.524496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.527111 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.527084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0af38e77-fb9c-46fa-9717-5604d30a7d3f-maas-api-tls\") pod \"maas-api-7446dd9f78-rr9g6\" (UID: \"0af38e77-fb9c-46fa-9717-5604d30a7d3f\") " pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.625744 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.625703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8kh9\" (UniqueName: \"kubernetes.io/projected/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-kube-api-access-f8kh9\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.625981 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.625853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x96x8\" (UniqueName: \"kubernetes.io/projected/5192747a-dade-4419-9409-470383b39b37-kube-api-access-x96x8\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.625981 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.625902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-plugins-config-volume\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.625981 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.625938 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5192747a-dade-4419-9409-470383b39b37-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.626799 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.626770 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5192747a-dade-4419-9409-470383b39b37-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.644414 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.644381 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x96x8\" (UniqueName: \"kubernetes.io/projected/5192747a-dade-4419-9409-470383b39b37-kube-api-access-x96x8\") pod \"payload-pre-processing-7964457696-wdtdx\" (UID: \"5192747a-dade-4419-9409-470383b39b37\") " pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.726543 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.726457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8kh9\" (UniqueName: \"kubernetes.io/projected/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-kube-api-access-f8kh9\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.726543 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.726507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-plugins-config-volume\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.727170 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.727151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-plugins-config-volume\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.737112 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.737088 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8kh9\" (UniqueName: \"kubernetes.io/projected/cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06-kube-api-access-f8kh9\") pod \"payload-processing-58f86c7798-hn2wf\" (UID: \"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06\") " pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.748924 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.748896 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:31.749037 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.748904 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:31.784764 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.784730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:31.936333 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.936257 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7446dd9f78-rr9g6"] Jul 07 15:51:31.936999 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:51:31.936769 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af38e77_fb9c_46fa_9717_5604d30a7d3f.slice/crio-4ecc995280874e60c204aa0610dddf5ec5b080e71bba41106c0ceb09bc88b0a1 WatchSource:0}: Error finding container 4ecc995280874e60c204aa0610dddf5ec5b080e71bba41106c0ceb09bc88b0a1: Status 404 returned error can't find the container with id 4ecc995280874e60c204aa0610dddf5ec5b080e71bba41106c0ceb09bc88b0a1 Jul 07 15:51:31.958005 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.957970 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wdtdx"] Jul 07 15:51:31.960024 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:51:31.959990 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5192747a_dade_4419_9409_470383b39b37.slice/crio-39009acecb3f34b3d97193f47a7abce1e6a174fb954242cca09197171039fd18 WatchSource:0}: Error finding container 39009acecb3f34b3d97193f47a7abce1e6a174fb954242cca09197171039fd18: Status 404 returned error can't find the container with id 39009acecb3f34b3d97193f47a7abce1e6a174fb954242cca09197171039fd18 Jul 07 15:51:31.986903 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:31.986878 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-hn2wf"] Jul 07 15:51:31.989692 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:51:31.989661 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1c6ad0_dda1_45ba_bcfb_2a2fc0570a06.slice/crio-44e6158e8c87b17c15b13d76ef9ac3b7ba0bdc9ea20abf47b192e0349a665898 WatchSource:0}: Error finding container 44e6158e8c87b17c15b13d76ef9ac3b7ba0bdc9ea20abf47b192e0349a665898: Status 404 returned error can't find the container with id 44e6158e8c87b17c15b13d76ef9ac3b7ba0bdc9ea20abf47b192e0349a665898 Jul 07 15:51:32.917864 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:32.917777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" event={"ID":"5192747a-dade-4419-9409-470383b39b37","Type":"ContainerStarted","Data":"39009acecb3f34b3d97193f47a7abce1e6a174fb954242cca09197171039fd18"} Jul 07 15:51:32.919191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:32.919118 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7446dd9f78-rr9g6" event={"ID":"0af38e77-fb9c-46fa-9717-5604d30a7d3f","Type":"ContainerStarted","Data":"4ecc995280874e60c204aa0610dddf5ec5b080e71bba41106c0ceb09bc88b0a1"} Jul 07 15:51:32.921040 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:32.920984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" event={"ID":"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06","Type":"ContainerStarted","Data":"44e6158e8c87b17c15b13d76ef9ac3b7ba0bdc9ea20abf47b192e0349a665898"} Jul 07 15:51:34.932248 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.932186 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" event={"ID":"5192747a-dade-4419-9409-470383b39b37","Type":"ContainerStarted","Data":"0127c07409187d5a750a8524739b2196025081950335cc4d0eb1671190b8bbb2"} Jul 07 15:51:34.932736 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.932286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:34.933715 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.933692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7446dd9f78-rr9g6" event={"ID":"0af38e77-fb9c-46fa-9717-5604d30a7d3f","Type":"ContainerStarted","Data":"570c1b7e234c32a2638befcc1dc662b77b740b76dee12cf6f983d5ec6991815d"} Jul 07 15:51:34.933839 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.933770 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:34.935113 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.935095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" event={"ID":"cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06","Type":"ContainerStarted","Data":"3650388c614ba086da4733daf3daaabeaf46af67b895d6d569a8588ce08166b1"} Jul 07 15:51:34.935190 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.935133 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:34.952492 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.952451 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" podStartSLOduration=1.804380704 podStartE2EDuration="3.952436994s" totalImagesPullingTime="2.14805629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:51:34.950392655 +0000 UTC m=+567.103170633" watchObservedRunningTime="2026-07-07 15:51:34.952436994 +0000 UTC m=+567.105214958" Jul 07 15:51:34.971234 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.971179 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" podStartSLOduration=1.849970879 podStartE2EDuration="3.971166878s" totalImagesPullingTime="2.121195999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:51:34.969123329 +0000 UTC m=+567.121901306" watchObservedRunningTime="2026-07-07 15:51:34.971166878 +0000 UTC m=+567.123944844" Jul 07 15:51:34.988651 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:34.988594 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7446dd9f78-rr9g6" podStartSLOduration=2.817362152 podStartE2EDuration="4.98857477s" totalImagesPullingTime="2.171212618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:51:34.987247997 +0000 UTC m=+567.140025964" watchObservedRunningTime="2026-07-07 15:51:34.98857477 +0000 UTC m=+567.141352737" Jul 07 15:51:39.960778 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.960747 2556 generic.go:356] "Generic (PLEG): container finished" podID="68f3b63b-0673-4f30-9b33-a6ed2e34bd9a" containerID="64ccc367ae4a9839de1977443ad1d286a08061295f73057e4eee409de8c3c7af" exitCode=0 Jul 07 15:51:39.961415 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.960791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" event={"ID":"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a","Type":"ContainerDied","Data":"64ccc367ae4a9839de1977443ad1d286a08061295f73057e4eee409de8c3c7af"} Jul 07 15:51:39.961415 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.961120 2556 scope.go:117] "RemoveContainer" containerID="64ccc367ae4a9839de1977443ad1d286a08061295f73057e4eee409de8c3c7af" Jul 07 15:51:39.962042 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.962016 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:51:39.962101 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.962081 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:51:39.962141 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:39.962113 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 15:51:40.945176 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:40.945147 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7446dd9f78-rr9g6" Jul 07 15:51:40.967492 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:40.967443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" event={"ID":"68f3b63b-0673-4f30-9b33-a6ed2e34bd9a","Type":"ContainerStarted","Data":"2855191915d138a6c50e527eb55fdcce84497a0f6258d9ff3c1f4f57bed88ef2"} Jul 07 15:51:41.541716 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:41.541670 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:51:41.541950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:41.541923 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-chxfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 07 15:51:41.542033 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:41.541983 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" podUID="68f3b63b-0673-4f30-9b33-a6ed2e34bd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 07 15:51:41.954534 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:41.954500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:42.052007 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:42.051972 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:42.540927 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:42.540894 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-chxfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 07 15:51:42.541104 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:42.540943 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" podUID="68f3b63b-0673-4f30-9b33-a6ed2e34bd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 07 15:51:43.541173 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:43.541141 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-chxfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 07 15:51:43.541644 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:43.541219 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" podUID="68f3b63b-0673-4f30-9b33-a6ed2e34bd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 07 15:51:44.541298 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:44.541263 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-chxfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 07 15:51:44.541678 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:44.541356 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" podUID="68f3b63b-0673-4f30-9b33-a6ed2e34bd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 07 15:51:44.830163 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:44.830131 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:45.544516 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:45.544481 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:51:45.544982 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:45.544849 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:51:45.545557 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:45.545538 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-chxfh" Jul 07 15:51:45.941106 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:45.941072 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-hn2wf" Jul 07 15:51:45.941453 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:45.941435 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-wdtdx" Jul 07 15:51:47.668107 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:47.668076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:48.974563 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:48.974518 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:55.669108 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:55.669078 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:59.943350 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.943315 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b"] Jul 07 15:51:59.947670 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.947647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.949920 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.949896 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w82p8\"" Jul 07 15:51:59.950077 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.949972 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 15:51:59.950077 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.950018 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 15:51:59.950495 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.950480 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 15:51:59.950665 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.950646 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b"] Jul 07 15:51:59.973676 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.973647 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:51:59.987020 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.986990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.987171 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.987028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.987171 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.987054 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.987287 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.987167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.987287 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.987193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fb9\" (UniqueName: \"kubernetes.io/projected/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-kube-api-access-89fb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:51:59.987287 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:51:59.987228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.088858 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.088805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.088858 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.088858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fb9\" (UniqueName: \"kubernetes.io/projected/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-kube-api-access-89fb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.088889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.088976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.089007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089224 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.089031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.089489 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.089525 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.089695 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.089652 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.092067 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.092037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.092191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.092137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.098682 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.098657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fb9\" (UniqueName: \"kubernetes.io/projected/fc0afbe5-ea2b-4904-b6df-275b5f7cc9df-kube-api-access-89fb9\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rtw6b\" (UID: \"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.260919 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.260813 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:00.404037 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:00.404012 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b"] Jul 07 15:52:00.406335 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:52:00.406303 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0afbe5_ea2b_4904_b6df_275b5f7cc9df.slice/crio-e809b4f189915a6c3093c14bbdc3af2ac209f87087bd87f448d5279535055a9e WatchSource:0}: Error finding container e809b4f189915a6c3093c14bbdc3af2ac209f87087bd87f448d5279535055a9e: Status 404 returned error can't find the container with id e809b4f189915a6c3093c14bbdc3af2ac209f87087bd87f448d5279535055a9e Jul 07 15:52:01.076906 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:01.076866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" event={"ID":"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df","Type":"ContainerStarted","Data":"e809b4f189915a6c3093c14bbdc3af2ac209f87087bd87f448d5279535055a9e"} Jul 07 15:52:02.084189 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:02.084151 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" event={"ID":"fc0afbe5-ea2b-4904-b6df-275b5f7cc9df","Type":"ContainerStarted","Data":"a5ac951323c1836bbbed478ea69dc1d9c55835047648bf239f4772165bdc5ec3"} Jul 07 15:52:02.108143 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:02.108083 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" podStartSLOduration=2.055377053 podStartE2EDuration="3.108066475s" totalImagesPullingTime="1.052689422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:02.106164309 +0000 UTC m=+594.258942276" watchObservedRunningTime="2026-07-07 15:52:02.108066475 +0000 UTC m=+594.260844440" Jul 07 15:52:04.540401 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:04.540374 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:04.643043 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:04.643005 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:05.941470 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:05.941433 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:06.015641 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.015602 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:06.233883 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.233802 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr"] Jul 07 15:52:06.237068 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.237043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.239533 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.239512 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 15:52:06.247911 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.247885 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr"] Jul 07 15:52:06.263921 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.263885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:06.345383 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.345383 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.345666 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88f382b-a72e-45d6-b1a5-4c36b033195b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.345666 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.345666 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.345666 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.345598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8ps\" (UniqueName: \"kubernetes.io/projected/b88f382b-a72e-45d6-b1a5-4c36b033195b-kube-api-access-rx8ps\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446364 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446540 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446540 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8ps\" (UniqueName: \"kubernetes.io/projected/b88f382b-a72e-45d6-b1a5-4c36b033195b-kube-api-access-rx8ps\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446540 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446540 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446453 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446540 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88f382b-a72e-45d6-b1a5-4c36b033195b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446831 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446811 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446891 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.446936 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.446923 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.448677 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.448657 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b88f382b-a72e-45d6-b1a5-4c36b033195b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.448856 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.448839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b88f382b-a72e-45d6-b1a5-4c36b033195b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.454893 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.454870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8ps\" (UniqueName: \"kubernetes.io/projected/b88f382b-a72e-45d6-b1a5-4c36b033195b-kube-api-access-rx8ps\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr\" (UID: \"b88f382b-a72e-45d6-b1a5-4c36b033195b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.549839 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.549808 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:06.687892 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:06.687862 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr"] Jul 07 15:52:06.689267 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:52:06.689234 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88f382b_a72e_45d6_b1a5_4c36b033195b.slice/crio-a31ac057669458cc841b529eee5c7849e0a7e0227cc9958b06943b2933d301e2 WatchSource:0}: Error finding container a31ac057669458cc841b529eee5c7849e0a7e0227cc9958b06943b2933d301e2: Status 404 returned error can't find the container with id a31ac057669458cc841b529eee5c7849e0a7e0227cc9958b06943b2933d301e2 Jul 07 15:52:07.111037 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:07.111002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" event={"ID":"b88f382b-a72e-45d6-b1a5-4c36b033195b","Type":"ContainerStarted","Data":"128af184c69f691a54785c080e681086b4794f37bb2eb3956186e5080f51ef80"} Jul 07 15:52:07.111497 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:07.111062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" event={"ID":"b88f382b-a72e-45d6-b1a5-4c36b033195b","Type":"ContainerStarted","Data":"a31ac057669458cc841b529eee5c7849e0a7e0227cc9958b06943b2933d301e2"} Jul 07 15:52:07.134018 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:07.133904 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" podStartSLOduration=0.950958146 podStartE2EDuration="1.133887833s" totalImagesPullingTime="182.929687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:07.131980116 +0000 UTC m=+599.284758081" watchObservedRunningTime="2026-07-07 15:52:07.133887833 +0000 UTC m=+599.286665808" Jul 07 15:52:08.285580 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:08.285549 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:52:08.286056 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:08.285570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:52:10.262013 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:10.261972 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:10.262635 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:10.262074 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:10.274029 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:10.274009 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:11.142119 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:11.142092 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rtw6b" Jul 07 15:52:16.550592 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:16.550547 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:16.551000 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:16.550628 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:16.563088 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:16.563060 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:17.172375 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:17.172346 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr" Jul 07 15:52:27.451939 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.451899 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r"] Jul 07 15:52:27.457519 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.457500 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.459945 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.459922 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 15:52:27.468541 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.468519 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r"] Jul 07 15:52:27.492800 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.492758 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:27.532958 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.532925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.533142 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.533017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djkss\" (UniqueName: \"kubernetes.io/projected/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-kube-api-access-djkss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.533142 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.533047 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.533263 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.533131 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.533263 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.533194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.533263 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.533234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.633991 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.633955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djkss\" (UniqueName: \"kubernetes.io/projected/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-kube-api-access-djkss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634191 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634514 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634444 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634585 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.634640 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.634615 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.636327 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.636308 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.636573 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.636557 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.644145 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.644117 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djkss\" (UniqueName: \"kubernetes.io/projected/9f1ebd5b-75a1-4d3b-88cd-bac825d386ee-kube-api-access-djkss\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qrp7r\" (UID: \"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.768425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.768332 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:27.910081 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.910059 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r"] Jul 07 15:52:27.912058 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:52:27.912033 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1ebd5b_75a1_4d3b_88cd_bac825d386ee.slice/crio-80397a0be5d30dd868bbdf81012af3d4ca0899498f79e767a365415c5be6b8ea WatchSource:0}: Error finding container 80397a0be5d30dd868bbdf81012af3d4ca0899498f79e767a365415c5be6b8ea: Status 404 returned error can't find the container with id 80397a0be5d30dd868bbdf81012af3d4ca0899498f79e767a365415c5be6b8ea Jul 07 15:52:27.913512 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:27.913486 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:52:28.214547 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:28.214520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" event={"ID":"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee","Type":"ContainerStarted","Data":"80397a0be5d30dd868bbdf81012af3d4ca0899498f79e767a365415c5be6b8ea"} Jul 07 15:52:29.221320 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:29.221279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" event={"ID":"9f1ebd5b-75a1-4d3b-88cd-bac825d386ee","Type":"ContainerStarted","Data":"2d993d8f3b0c87456b091446897b0d1a34becef8d8024dae89b14fdd89b3a03c"} Jul 07 15:52:29.241474 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:29.241414 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" podStartSLOduration=1.995129383 podStartE2EDuration="2.241395828s" totalImagesPullingTime="246.266445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:29.239324881 +0000 UTC m=+621.392102858" watchObservedRunningTime="2026-07-07 15:52:29.241395828 +0000 UTC m=+621.394173832" Jul 07 15:52:37.768979 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:37.768942 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:37.769599 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:37.769033 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:37.781131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:37.781109 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:38.277705 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:38.277677 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qrp7r" Jul 07 15:52:41.845412 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.845380 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6"] Jul 07 15:52:41.853847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.853822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.856196 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.856173 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 07 15:52:41.860435 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.860409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6"] Jul 07 15:52:41.882707 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.882679 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:41.968003 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.967942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.968174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.968011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.968174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.968043 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.968174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.968066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.968174 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.968155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zvmn\" (UniqueName: \"kubernetes.io/projected/394348b3-0798-4db4-bf64-b7f8de6a5bf0-kube-api-access-2zvmn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:41.968363 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:41.968192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069232 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zvmn\" (UniqueName: \"kubernetes.io/projected/394348b3-0798-4db4-bf64-b7f8de6a5bf0-kube-api-access-2zvmn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069420 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069705 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069639 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069705 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069678 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.069801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.069784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.071692 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.071667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/394348b3-0798-4db4-bf64-b7f8de6a5bf0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.071932 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.071917 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/394348b3-0798-4db4-bf64-b7f8de6a5bf0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.079248 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.079192 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zvmn\" (UniqueName: \"kubernetes.io/projected/394348b3-0798-4db4-bf64-b7f8de6a5bf0-kube-api-access-2zvmn\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6\" (UID: \"394348b3-0798-4db4-bf64-b7f8de6a5bf0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.164999 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.164908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:42.313229 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:42.313192 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6"] Jul 07 15:52:42.315480 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:52:42.315453 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod394348b3_0798_4db4_bf64_b7f8de6a5bf0.slice/crio-4f5013bb382ef5a96acb9ec6fc681a7fcd6dfbb5b31cdbebc17dc9b075749380 WatchSource:0}: Error finding container 4f5013bb382ef5a96acb9ec6fc681a7fcd6dfbb5b31cdbebc17dc9b075749380: Status 404 returned error can't find the container with id 4f5013bb382ef5a96acb9ec6fc681a7fcd6dfbb5b31cdbebc17dc9b075749380 Jul 07 15:52:43.293961 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:43.293930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" event={"ID":"394348b3-0798-4db4-bf64-b7f8de6a5bf0","Type":"ContainerStarted","Data":"abf14c5b64905f2b130b1e7bcad6885bca614763f64ba260686feaf0391a694d"} Jul 07 15:52:43.293961 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:43.293969 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" event={"ID":"394348b3-0798-4db4-bf64-b7f8de6a5bf0","Type":"ContainerStarted","Data":"4f5013bb382ef5a96acb9ec6fc681a7fcd6dfbb5b31cdbebc17dc9b075749380"} Jul 07 15:52:43.315421 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:43.315363 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" podStartSLOduration=2.093045938 podStartE2EDuration="2.315345073s" totalImagesPullingTime="222.299135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:43.31323832 +0000 UTC m=+635.466016285" watchObservedRunningTime="2026-07-07 15:52:43.315345073 +0000 UTC m=+635.468123038" Jul 07 15:52:51.251158 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:51.251122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:52:52.165960 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:52.165920 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:52.166173 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:52.166151 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:52.181183 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:52.181154 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:52:52.356131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:52:52.356104 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6" Jul 07 15:53:00.477008 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:00.476973 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:00.573410 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:00.573373 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:29.516726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.516693 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c849d55cd-52jm9"] Jul 07 15:53:29.520426 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.520408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.532075 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.532051 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c849d55cd-52jm9"] Jul 07 15:53:29.602468 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.602433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-tls-cert\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.602468 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.602472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkkcw\" (UniqueName: \"kubernetes.io/projected/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-kube-api-access-vkkcw\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.703923 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.703887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-tls-cert\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.703923 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.703930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkkcw\" (UniqueName: \"kubernetes.io/projected/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-kube-api-access-vkkcw\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.706425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.706399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-tls-cert\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.715132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.715109 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkkcw\" (UniqueName: \"kubernetes.io/projected/ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8-kube-api-access-vkkcw\") pod \"authorino-6c849d55cd-52jm9\" (UID: \"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8\") " pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.830497 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.830468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c849d55cd-52jm9" Jul 07 15:53:29.863532 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.863494 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:29.965074 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.965035 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:29.976139 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:29.976116 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c849d55cd-52jm9"] Jul 07 15:53:29.979641 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:53:29.979611 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad3125a2_cdd6_4653_bb7e_f387a5c6e0c8.slice/crio-618ab1c63468c691ddcc1433044f77679a77f22422652134164e3f310853c98a WatchSource:0}: Error finding container 618ab1c63468c691ddcc1433044f77679a77f22422652134164e3f310853c98a: Status 404 returned error can't find the container with id 618ab1c63468c691ddcc1433044f77679a77f22422652134164e3f310853c98a Jul 07 15:53:30.533847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.533808 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c849d55cd-52jm9" event={"ID":"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8","Type":"ContainerStarted","Data":"22faaf34f62a0db66895d4e493828d7fa3bfd302e2bd3d4e7f8b98ce40f249c5"} Jul 07 15:53:30.533847 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.533853 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c849d55cd-52jm9" event={"ID":"ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8","Type":"ContainerStarted","Data":"618ab1c63468c691ddcc1433044f77679a77f22422652134164e3f310853c98a"} Jul 07 15:53:30.552838 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.552778 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c849d55cd-52jm9" podStartSLOduration=1.203087438 podStartE2EDuration="1.552758645s" totalImagesPullingTime="349.671207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:53:30.549964091 +0000 UTC m=+682.702742056" watchObservedRunningTime="2026-07-07 15:53:30.552758645 +0000 UTC m=+682.705536609" Jul 07 15:53:30.587184 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.587091 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:53:30.587649 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.587614 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" podUID="109a026c-e5b5-403e-8166-c28f9b99f3b3" containerName="authorino" containerID="cri-o://fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6" gracePeriod=30 Jul 07 15:53:30.857562 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.857533 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:53:30.916726 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.916689 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert\") pod \"109a026c-e5b5-403e-8166-c28f9b99f3b3\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " Jul 07 15:53:30.916915 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.916769 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th5s2\" (UniqueName: \"kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2\") pod \"109a026c-e5b5-403e-8166-c28f9b99f3b3\" (UID: \"109a026c-e5b5-403e-8166-c28f9b99f3b3\") " Jul 07 15:53:30.918953 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.918920 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2" (OuterVolumeSpecName: "kube-api-access-th5s2") pod "109a026c-e5b5-403e-8166-c28f9b99f3b3" (UID: "109a026c-e5b5-403e-8166-c28f9b99f3b3"). InnerVolumeSpecName "kube-api-access-th5s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:53:30.930152 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:30.930119 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "109a026c-e5b5-403e-8166-c28f9b99f3b3" (UID: "109a026c-e5b5-403e-8166-c28f9b99f3b3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:53:31.018141 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.018105 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/109a026c-e5b5-403e-8166-c28f9b99f3b3-tls-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:53:31.018141 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.018143 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th5s2\" (UniqueName: \"kubernetes.io/projected/109a026c-e5b5-403e-8166-c28f9b99f3b3-kube-api-access-th5s2\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:53:31.108027 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.107935 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:31.220496 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.220450 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:53:31.540102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.540012 2556 generic.go:356] "Generic (PLEG): container finished" podID="109a026c-e5b5-403e-8166-c28f9b99f3b3" containerID="fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6" exitCode=0 Jul 07 15:53:31.540102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.540061 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" Jul 07 15:53:31.540102 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.540094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" event={"ID":"109a026c-e5b5-403e-8166-c28f9b99f3b3","Type":"ContainerDied","Data":"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6"} Jul 07 15:53:31.540649 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.540133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f5f54f5f-jm4pp" event={"ID":"109a026c-e5b5-403e-8166-c28f9b99f3b3","Type":"ContainerDied","Data":"0d60493f68a22f02e75e721bdbe79ce69770ce6f2c47bdec6481dadc58865b02"} Jul 07 15:53:31.540649 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.540149 2556 scope.go:117] "RemoveContainer" containerID="fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6" Jul 07 15:53:31.548813 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.548794 2556 scope.go:117] "RemoveContainer" containerID="fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6" Jul 07 15:53:31.549068 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:53:31.549051 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6\": container with ID starting with fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6 not found: ID does not exist" containerID="fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6" Jul 07 15:53:31.549132 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.549076 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6"} err="failed to get container status \"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6\": rpc error: code = NotFound desc = could not find container \"fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6\": container with ID starting with fe3c20f79eaf07e02bfa0cbb1db6e09573dfb7f3836337b461504807b93b54a6 not found: ID does not exist" Jul 07 15:53:31.572321 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.572280 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:53:31.581404 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:31.581376 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9f5f54f5f-jm4pp"] Jul 07 15:53:32.420944 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:53:32.420914 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109a026c-e5b5-403e-8166-c28f9b99f3b3" path="/var/lib/kubelet/pods/109a026c-e5b5-403e-8166-c28f9b99f3b3/volumes" Jul 07 15:54:43.016796 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.016763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:43.120845 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.120805 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:54:43.121070 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.121040 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" podUID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" containerName="manager" containerID="cri-o://f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8" gracePeriod=30 Jul 07 15:54:43.373643 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.373616 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:54:43.492436 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.492391 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert\") pod \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " Jul 07 15:54:43.492436 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.492450 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5ddw\" (UniqueName: \"kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw\") pod \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\" (UID: \"842bf884-39a8-4a0a-904e-cfa1ca7fe97f\") " Jul 07 15:54:43.494479 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.494438 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "842bf884-39a8-4a0a-904e-cfa1ca7fe97f" (UID: "842bf884-39a8-4a0a-904e-cfa1ca7fe97f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:54:43.494603 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.494530 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw" (OuterVolumeSpecName: "kube-api-access-j5ddw") pod "842bf884-39a8-4a0a-904e-cfa1ca7fe97f" (UID: "842bf884-39a8-4a0a-904e-cfa1ca7fe97f"). InnerVolumeSpecName "kube-api-access-j5ddw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:54:43.593762 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.593728 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-webhook-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:54:43.593762 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.593757 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5ddw\" (UniqueName: \"kubernetes.io/projected/842bf884-39a8-4a0a-904e-cfa1ca7fe97f-kube-api-access-j5ddw\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:54:43.903722 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.903637 2556 generic.go:356] "Generic (PLEG): container finished" podID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" containerID="f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8" exitCode=0 Jul 07 15:54:43.903722 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.903682 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" Jul 07 15:54:43.903722 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.903703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" event={"ID":"842bf884-39a8-4a0a-904e-cfa1ca7fe97f","Type":"ContainerDied","Data":"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8"} Jul 07 15:54:43.903955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.903745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-rl5t4" event={"ID":"842bf884-39a8-4a0a-904e-cfa1ca7fe97f","Type":"ContainerDied","Data":"762ccd44ea960594f4e10c85dd1602a6d53fc89f5fc36cc80f1634a5e59d302c"} Jul 07 15:54:43.903955 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.903766 2556 scope.go:117] "RemoveContainer" containerID="f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8" Jul 07 15:54:43.913242 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.913221 2556 scope.go:117] "RemoveContainer" containerID="f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8" Jul 07 15:54:43.913503 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:54:43.913486 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8\": container with ID starting with f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8 not found: ID does not exist" containerID="f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8" Jul 07 15:54:43.913567 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.913511 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8"} err="failed to get container status \"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8\": rpc error: code = NotFound desc = could not find container \"f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8\": container with ID starting with f0c71f591a460cb59fad453c7bc6c561c94652d985ee0f526f8d8b8d1c4fdbd8 not found: ID does not exist" Jul 07 15:54:43.927446 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.927420 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:54:43.932482 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:43.932456 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-rl5t4"] Jul 07 15:54:44.420316 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.420284 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" path="/var/lib/kubelet/pods/842bf884-39a8-4a0a-904e-cfa1ca7fe97f/volumes" Jul 07 15:54:44.664703 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.664671 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:54:44.740950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.740862 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-lmf8c"] Jul 07 15:54:44.741371 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741352 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" containerName="manager" Jul 07 15:54:44.741474 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741373 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" containerName="manager" Jul 07 15:54:44.741474 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741388 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="109a026c-e5b5-403e-8166-c28f9b99f3b3" containerName="authorino" Jul 07 15:54:44.741474 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741397 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="109a026c-e5b5-403e-8166-c28f9b99f3b3" containerName="authorino" Jul 07 15:54:44.741629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741528 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="842bf884-39a8-4a0a-904e-cfa1ca7fe97f" containerName="manager" Jul 07 15:54:44.741629 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.741542 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="109a026c-e5b5-403e-8166-c28f9b99f3b3" containerName="authorino" Jul 07 15:54:44.745872 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.745848 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.748120 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.748098 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 15:54:44.748781 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.748761 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 15:54:44.748908 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.748834 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-knb7s\"" Jul 07 15:54:44.757588 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.757563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-lmf8c"] Jul 07 15:54:44.806024 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.805992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s8ht\" (UniqueName: \"kubernetes.io/projected/0b528170-8977-4d17-ab40-36d677331309-kube-api-access-2s8ht\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.806201 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.806034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b528170-8977-4d17-ab40-36d677331309-webhook-cert\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.906840 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.906808 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s8ht\" (UniqueName: \"kubernetes.io/projected/0b528170-8977-4d17-ab40-36d677331309-kube-api-access-2s8ht\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.907030 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.906858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b528170-8977-4d17-ab40-36d677331309-webhook-cert\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.909500 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.909472 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b528170-8977-4d17-ab40-36d677331309-webhook-cert\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:44.916848 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:44.916812 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s8ht\" (UniqueName: \"kubernetes.io/projected/0b528170-8977-4d17-ab40-36d677331309-kube-api-access-2s8ht\") pod \"maas-controller-7b74d8f87b-lmf8c\" (UID: \"0b528170-8977-4d17-ab40-36d677331309\") " pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:45.056529 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:45.056488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:45.200973 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:45.200946 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b74d8f87b-lmf8c"] Jul 07 15:54:45.203367 ip-10-0-132-99 kubenswrapper[2556]: W0707 15:54:45.203337 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b528170_8977_4d17_ab40_36d677331309.slice/crio-32e38f00edaad591e62c728840180c101039754fc498c3e57df3b88a24c2e15e WatchSource:0}: Error finding container 32e38f00edaad591e62c728840180c101039754fc498c3e57df3b88a24c2e15e: Status 404 returned error can't find the container with id 32e38f00edaad591e62c728840180c101039754fc498c3e57df3b88a24c2e15e Jul 07 15:54:45.918696 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:45.918662 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" event={"ID":"0b528170-8977-4d17-ab40-36d677331309","Type":"ContainerStarted","Data":"32e38f00edaad591e62c728840180c101039754fc498c3e57df3b88a24c2e15e"} Jul 07 15:54:46.924828 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:46.924798 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" event={"ID":"0b528170-8977-4d17-ab40-36d677331309","Type":"ContainerStarted","Data":"513879ac756c234e96bc01c6648905031c0fbe500b9b663fa4f3e094c448e111"} Jul 07 15:54:46.925275 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:46.924919 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:54:46.977818 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:46.977764 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" podStartSLOduration=2.330673038 podStartE2EDuration="2.977746468s" totalImagesPullingTime="647.07343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:54:46.977260299 +0000 UTC m=+759.130038266" watchObservedRunningTime="2026-07-07 15:54:46.977746468 +0000 UTC m=+759.130524433" Jul 07 15:54:57.938523 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:54:57.938490 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b74d8f87b-lmf8c" Jul 07 15:55:03.143221 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:03.143184 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:03.248063 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:03.248030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:26.754495 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:26.754439 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:26.855029 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:26.854983 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:26.972393 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:26.972359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:35.865481 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:35.865395 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:35.958053 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:35.957991 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:36.067743 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:36.067697 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:36.260220 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:36.260116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:44.404582 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:44.404543 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:55:44.526864 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:55:44.526828 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:56:08.977138 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:56:08.977082 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:56:09.048036 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:56:09.048006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:57:08.317316 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:57:08.317242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:57:08.318383 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:57:08.318357 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 15:57:19.179310 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:57:19.179276 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:57:47.585801 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:57:47.585768 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 15:59:39.475829 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:39.475794 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:59:39.476425 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:39.476010 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" podUID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" containerName="manager" containerID="cri-o://79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110" gracePeriod=10 Jul 07 15:59:42.931995 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:42.931968 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:59:43.025167 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.025094 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87tjq\" (UniqueName: \"kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq\") pod \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " Jul 07 15:59:43.025323 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.025174 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume\") pod \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\" (UID: \"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131\") " Jul 07 15:59:43.025524 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.025495 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" (UID: "1ffef17c-bb0c-4ff0-b1e1-3ee72b615131"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:59:43.027011 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.026984 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq" (OuterVolumeSpecName: "kube-api-access-87tjq") pod "1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" (UID: "1ffef17c-bb0c-4ff0-b1e1-3ee72b615131"). InnerVolumeSpecName "kube-api-access-87tjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:59:43.126561 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.126522 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87tjq\" (UniqueName: \"kubernetes.io/projected/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-kube-api-access-87tjq\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:59:43.126561 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.126560 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131-extensions-socket-volume\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 15:59:43.432731 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.432697 2556 generic.go:356] "Generic (PLEG): container finished" podID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" containerID="79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110" exitCode=0 Jul 07 15:59:43.432731 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.432734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" event={"ID":"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131","Type":"ContainerDied","Data":"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110"} Jul 07 15:59:43.432950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.432772 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" event={"ID":"1ffef17c-bb0c-4ff0-b1e1-3ee72b615131","Type":"ContainerDied","Data":"8ee47db888f4c22e3054ff68bf1051d5f235032eb7d36a7224be6f0ecdcc9d48"} Jul 07 15:59:43.432950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.432792 2556 scope.go:117] "RemoveContainer" containerID="79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110" Jul 07 15:59:43.432950 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.432738 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4" Jul 07 15:59:43.442617 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.442597 2556 scope.go:117] "RemoveContainer" containerID="79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110" Jul 07 15:59:43.442885 ip-10-0-132-99 kubenswrapper[2556]: E0707 15:59:43.442861 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110\": container with ID starting with 79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110 not found: ID does not exist" containerID="79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110" Jul 07 15:59:43.442926 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.442899 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110"} err="failed to get container status \"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110\": rpc error: code = NotFound desc = could not find container \"79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110\": container with ID starting with 79864f1f78e6e9b21b9f0b4ce46a8aeaab54065575c0055a1412391780a67110 not found: ID does not exist" Jul 07 15:59:43.457223 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.457185 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:59:43.463131 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:43.463111 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzjq4"] Jul 07 15:59:44.419990 ip-10-0-132-99 kubenswrapper[2556]: I0707 15:59:44.419958 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" path="/var/lib/kubelet/pods/1ffef17c-bb0c-4ff0-b1e1-3ee72b615131/volumes" Jul 07 16:00:40.683434 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.683395 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m"] Jul 07 16:00:40.683921 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.683794 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" containerName="manager" Jul 07 16:00:40.683921 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.683806 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" containerName="manager" Jul 07 16:00:40.683921 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.683865 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ffef17c-bb0c-4ff0-b1e1-3ee72b615131" containerName="manager" Jul 07 16:00:40.686648 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.686628 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.689167 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.689144 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wsqzl\"" Jul 07 16:00:40.701165 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.701143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m"] Jul 07 16:00:40.859181 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.859143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef5dce55-e068-49d1-b6a7-5b51726d7551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.859181 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.859183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29d6z\" (UniqueName: \"kubernetes.io/projected/ef5dce55-e068-49d1-b6a7-5b51726d7551-kube-api-access-29d6z\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.960767 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.960684 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef5dce55-e068-49d1-b6a7-5b51726d7551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.960767 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.960717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29d6z\" (UniqueName: \"kubernetes.io/projected/ef5dce55-e068-49d1-b6a7-5b51726d7551-kube-api-access-29d6z\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.961025 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.961007 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef5dce55-e068-49d1-b6a7-5b51726d7551-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.971040 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.971008 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29d6z\" (UniqueName: \"kubernetes.io/projected/ef5dce55-e068-49d1-b6a7-5b51726d7551-kube-api-access-29d6z\") pod \"kuadrant-operator-controller-manager-86878c769f-xc76m\" (UID: \"ef5dce55-e068-49d1-b6a7-5b51726d7551\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:40.996866 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:40.996840 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:41.133480 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.133454 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m"] Jul 07 16:00:41.135607 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:00:41.135578 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5dce55_e068_49d1_b6a7_5b51726d7551.slice/crio-19df0faae1fe3e1bfc19ef4d10c19ab6e067270b9776d50eec179a5fdcb1211b WatchSource:0}: Error finding container 19df0faae1fe3e1bfc19ef4d10c19ab6e067270b9776d50eec179a5fdcb1211b: Status 404 returned error can't find the container with id 19df0faae1fe3e1bfc19ef4d10c19ab6e067270b9776d50eec179a5fdcb1211b Jul 07 16:00:41.717617 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.717580 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" event={"ID":"ef5dce55-e068-49d1-b6a7-5b51726d7551","Type":"ContainerStarted","Data":"ef7c484d5e008391b82836386f31b8855f5098ec46034b6f5989d1c2c9905784"} Jul 07 16:00:41.718107 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.717641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" event={"ID":"ef5dce55-e068-49d1-b6a7-5b51726d7551","Type":"ContainerStarted","Data":"19df0faae1fe3e1bfc19ef4d10c19ab6e067270b9776d50eec179a5fdcb1211b"} Jul 07 16:00:41.718107 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.717676 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:00:41.748355 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.748305 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" podStartSLOduration=1.748289166 podStartE2EDuration="1.748289166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:00:41.74756665 +0000 UTC m=+1113.900344607" watchObservedRunningTime="2026-07-07 16:00:41.748289166 +0000 UTC m=+1113.901067131" Jul 07 16:00:41.812406 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:41.812368 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:00:52.724625 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:00:52.724589 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xc76m" Jul 07 16:02:08.346387 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:02:08.346356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:02:08.348028 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:02:08.348007 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:02:56.096682 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:02:56.096632 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:15.193499 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:04:15.193407 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:04:33.105468 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:04:33.105363 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:34.076620 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:06:34.076536 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:43.688474 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:06:43.688431 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:51.976526 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:06:51.976483 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:06:57.186439 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:06:57.186407 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:05.321182 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:05.321134 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:05.425108 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:05.425068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:05.838497 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:05.838468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:08.375251 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:08.375199 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:07:08.378670 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:08.378649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:07:12.524050 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.524017 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:12.527702 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.527676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.529914 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.529893 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ac5352d4-openshift-default-dockercfg-x4fzv\"" Jul 07 16:07:12.555565 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.555539 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:12.581151 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581323 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581323 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvq24\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581323 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581323 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581465 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581465 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581529 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581475 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.581529 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.581511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682188 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682272 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvq24\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682709 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682709 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682709 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682561 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682709 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682622 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682709 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682669 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.682968 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.683029 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.682970 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.683354 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.683327 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.684987 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.684953 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.685476 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.685456 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.695566 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.695539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvq24\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.696334 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.696312 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token\") pod \"e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.838275 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.838240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:12.985001 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.984971 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:12.986484 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:07:12.986456 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0257b834_a690_45f9_b4b6_1e3fdaa10633.slice/crio-8cc66e0f0e8e6fddf4971bd5294a0b4e49573e06dfcc3ba99bd4f3b133982372 WatchSource:0}: Error finding container 8cc66e0f0e8e6fddf4971bd5294a0b4e49573e06dfcc3ba99bd4f3b133982372: Status 404 returned error can't find the container with id 8cc66e0f0e8e6fddf4971bd5294a0b4e49573e06dfcc3ba99bd4f3b133982372 Jul 07 16:07:12.988726 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.988690 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:12.988843 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.988780 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:12.988843 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:12.988827 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:13.278622 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.278525 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:13.376863 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.376827 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:13.670284 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.670245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" event={"ID":"0257b834-a690-45f9-b4b6-1e3fdaa10633","Type":"ContainerStarted","Data":"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f"} Jul 07 16:07:13.670698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.670306 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" event={"ID":"0257b834-a690-45f9-b4b6-1e3fdaa10633","Type":"ContainerStarted","Data":"8cc66e0f0e8e6fddf4971bd5294a0b4e49573e06dfcc3ba99bd4f3b133982372"} Jul 07 16:07:13.699420 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.699370 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" podStartSLOduration=1.699352358 podStartE2EDuration="1.699352358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:07:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:07:13.696571293 +0000 UTC m=+1505.849349268" watchObservedRunningTime="2026-07-07 16:07:13.699352358 +0000 UTC m=+1505.852130323" Jul 07 16:07:13.765790 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.765761 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:13.839358 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.839324 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:13.876113 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:13.876083 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:14.015749 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:14.015647 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:14.142142 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:14.142109 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:14.394047 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:14.394013 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:14.494486 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:14.494455 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:14.844662 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:14.844636 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:15.682197 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:15.682155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:15.683237 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:15.683192 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:16.184283 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:16.184248 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:18.911505 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:18.911465 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:19.046950 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:19.046914 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:19.047130 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:19.047097 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" podUID="0257b834-a690-45f9-b4b6-1e3fdaa10633" containerName="istio-proxy" containerID="cri-o://01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f" gracePeriod=30 Jul 07 16:07:19.094271 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:19.094233 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:19.199763 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:19.199643 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:19.391044 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:19.390987 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:20.424823 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:20.424797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:24.409955 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.409898 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:24.503930 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.503843 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.503930 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.503887 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504148 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.503948 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504148 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.503968 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504148 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.503986 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504148 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504007 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504148 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504025 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504433 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504142 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504433 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504173 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:24.504433 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504234 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvq24\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24\") pod \"0257b834-a690-45f9-b4b6-1e3fdaa10633\" (UID: \"0257b834-a690-45f9-b4b6-1e3fdaa10633\") " Jul 07 16:07:24.504601 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504437 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:24.504601 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504498 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:24.504718 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504674 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-certs\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.504718 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504693 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-credential-socket\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.504718 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504706 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-workload-socket\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.504913 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.504840 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data" (OuterVolumeSpecName: "istio-data") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:24.505049 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.505028 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:07:24.506401 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.506373 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:07:24.506877 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.506849 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token" (OuterVolumeSpecName: "istio-token") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:24.506990 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.506929 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:24.506990 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.506939 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24" (OuterVolumeSpecName: "kube-api-access-fvq24") pod "0257b834-a690-45f9-b4b6-1e3fdaa10633" (UID: "0257b834-a690-45f9-b4b6-1e3fdaa10633"). InnerVolumeSpecName "kube-api-access-fvq24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:24.605440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605407 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-data\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.605440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605437 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-podinfo\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.605440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605447 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-token\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.605659 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605455 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0257b834-a690-45f9-b4b6-1e3fdaa10633-istiod-ca-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.605659 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605463 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0257b834-a690-45f9-b4b6-1e3fdaa10633-istio-envoy\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.605659 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.605471 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvq24\" (UniqueName: \"kubernetes.io/projected/0257b834-a690-45f9-b4b6-1e3fdaa10633-kube-api-access-fvq24\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:24.734831 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.734799 2556 generic.go:356] "Generic (PLEG): container finished" podID="0257b834-a690-45f9-b4b6-1e3fdaa10633" containerID="01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f" exitCode=0 Jul 07 16:07:24.735007 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.734847 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" Jul 07 16:07:24.735007 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.734853 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" event={"ID":"0257b834-a690-45f9-b4b6-1e3fdaa10633","Type":"ContainerDied","Data":"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f"} Jul 07 16:07:24.735007 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.734896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m" event={"ID":"0257b834-a690-45f9-b4b6-1e3fdaa10633","Type":"ContainerDied","Data":"8cc66e0f0e8e6fddf4971bd5294a0b4e49573e06dfcc3ba99bd4f3b133982372"} Jul 07 16:07:24.735007 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.734916 2556 scope.go:117] "RemoveContainer" containerID="01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f" Jul 07 16:07:24.744594 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.744576 2556 scope.go:117] "RemoveContainer" containerID="01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f" Jul 07 16:07:24.744860 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:07:24.744844 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f\": container with ID starting with 01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f not found: ID does not exist" containerID="01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f" Jul 07 16:07:24.744919 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.744872 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f"} err="failed to get container status \"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f\": rpc error: code = NotFound desc = could not find container \"01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f\": container with ID starting with 01da1c8779ceb79d7453995c1e070eaa7d283077d982be6ae778345587d7455f not found: ID does not exist" Jul 07 16:07:24.760136 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.760070 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:24.772088 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:24.772059 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ac5352d4-openshift-default-75979f7697-chq9m"] Jul 07 16:07:26.067659 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:26.067619 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:26.177108 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:26.177061 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:26.320893 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:26.320815 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:26.419967 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:26.419931 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0257b834-a690-45f9-b4b6-1e3fdaa10633" path="/var/lib/kubelet/pods/0257b834-a690-45f9-b4b6-1e3fdaa10633/volumes" Jul 07 16:07:26.434332 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:26.434299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.443314 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:27.443281 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.542013 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:27.541984 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.707784 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:27.707697 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:27.923187 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:27.923152 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:28.554440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:28.554405 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:28.657487 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:28.657442 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:29.385178 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:29.385137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:32.696776 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:32.696738 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:33.165732 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:33.165696 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:38.913894 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:38.913861 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:39.044561 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:39.044529 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.038790 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.038759 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.146933 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.146901 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.267478 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.267446 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.348890 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.348860 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:46.349426 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.349403 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0257b834-a690-45f9-b4b6-1e3fdaa10633" containerName="istio-proxy" Jul 07 16:07:46.349426 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.349424 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0257b834-a690-45f9-b4b6-1e3fdaa10633" containerName="istio-proxy" Jul 07 16:07:46.349599 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.349494 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0257b834-a690-45f9-b4b6-1e3fdaa10633" containerName="istio-proxy" Jul 07 16:07:46.352501 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.352471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.354908 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.354884 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f839a472-openshift-default-dockercfg-9wdqj\"" Jul 07 16:07:46.378607 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.378580 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:46.395588 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.395564 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.405666 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405772 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405772 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405772 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405881 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405881 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405955 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtll5\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.405994 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.405981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.406042 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.406031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.506927 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.506894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtll5\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507135 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.506945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507135 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.506986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507135 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507135 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507041 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507695 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507664 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507824 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507771 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507824 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507794 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.507937 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.508005 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.507984 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.509564 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.509537 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.509702 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.509686 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.524149 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.524124 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtll5\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.525804 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.525782 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token\") pod \"e2e-derive-f839a472-openshift-default-69766f9479-vw96k\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.540546 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.540516 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:46.663431 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.663348 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:46.924001 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:07:46.923969 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76af251_74cc_42c0_9b0f_0dba52484f0f.slice/crio-86e70923a420ccc04a5910a063733def990a73e4b040f0ec116743215b5009d5 WatchSource:0}: Error finding container 86e70923a420ccc04a5910a063733def990a73e4b040f0ec116743215b5009d5: Status 404 returned error can't find the container with id 86e70923a420ccc04a5910a063733def990a73e4b040f0ec116743215b5009d5 Jul 07 16:07:46.926249 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.926200 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:46.926323 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.926302 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:46.926366 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.926342 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 07 16:07:46.927485 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:46.927463 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:47.707174 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:47.707133 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:47.845675 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:47.845640 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:47.854816 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:47.854787 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" event={"ID":"b76af251-74cc-42c0-9b0f-0dba52484f0f","Type":"ContainerStarted","Data":"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4"} Jul 07 16:07:47.854963 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:47.854840 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" event={"ID":"b76af251-74cc-42c0-9b0f-0dba52484f0f","Type":"ContainerStarted","Data":"86e70923a420ccc04a5910a063733def990a73e4b040f0ec116743215b5009d5"} Jul 07 16:07:47.915595 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:47.915543 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" podStartSLOduration=1.915524962 podStartE2EDuration="1.915524962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:07:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:07:47.914816509 +0000 UTC m=+1540.067594474" watchObservedRunningTime="2026-07-07 16:07:47.915524962 +0000 UTC m=+1540.068302927" Jul 07 16:07:48.046137 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.046048 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:48.405062 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.405028 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:48.664241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.664136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:48.669248 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.669226 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:48.851683 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.851650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:48.859866 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.859839 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:48.860770 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:48.860748 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:49.015692 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:49.015654 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:49.962441 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:49.962403 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.181395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.181356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.350902 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.350869 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:52.351098 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.351077 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" podUID="b76af251-74cc-42c0-9b0f-0dba52484f0f" containerName="istio-proxy" containerID="cri-o://8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4" gracePeriod=30 Jul 07 16:07:52.412379 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.412351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.539662 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.539563 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:52.794163 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:52.794076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:54.205440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:54.205403 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:07:57.599818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.599792 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:57.717911 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717817 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.717911 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717866 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.717911 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717901 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717927 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717960 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.717984 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718058 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718157 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718241 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718183 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtll5\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5\") pod \"b76af251-74cc-42c0-9b0f-0dba52484f0f\" (UID: \"b76af251-74cc-42c0-9b0f-0dba52484f0f\") " Jul 07 16:07:57.718524 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718296 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:57.718524 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718315 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:57.718964 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.718792 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:07:57.719276 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.719175 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:57.720811 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.719415 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:57.720811 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.720002 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b76af251-74cc-42c0-9b0f-0dba52484f0f-istiod-ca-cert\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.720811 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.720033 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-certs\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.720811 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.720047 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-workload-socket\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.721081 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.720859 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 16:07:57.722632 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.722355 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:57.724354 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.724323 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:07:57.724354 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.724337 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5" (OuterVolumeSpecName: "kube-api-access-xtll5") pod "b76af251-74cc-42c0-9b0f-0dba52484f0f" (UID: "b76af251-74cc-42c0-9b0f-0dba52484f0f"). InnerVolumeSpecName "kube-api-access-xtll5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:07:57.821292 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821250 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-token\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.821292 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821282 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-podinfo\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.821292 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821291 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-envoy\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.821292 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821300 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-istio-data\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.821567 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821308 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b76af251-74cc-42c0-9b0f-0dba52484f0f-credential-socket\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.821567 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.821319 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtll5\" (UniqueName: \"kubernetes.io/projected/b76af251-74cc-42c0-9b0f-0dba52484f0f-kube-api-access-xtll5\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:07:57.906046 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.906010 2556 generic.go:356] "Generic (PLEG): container finished" podID="b76af251-74cc-42c0-9b0f-0dba52484f0f" containerID="8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4" exitCode=0 Jul 07 16:07:57.906185 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.906070 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" Jul 07 16:07:57.906185 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.906073 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" event={"ID":"b76af251-74cc-42c0-9b0f-0dba52484f0f","Type":"ContainerDied","Data":"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4"} Jul 07 16:07:57.906185 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.906147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k" event={"ID":"b76af251-74cc-42c0-9b0f-0dba52484f0f","Type":"ContainerDied","Data":"86e70923a420ccc04a5910a063733def990a73e4b040f0ec116743215b5009d5"} Jul 07 16:07:57.906185 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.906171 2556 scope.go:117] "RemoveContainer" containerID="8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4" Jul 07 16:07:57.915899 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.915877 2556 scope.go:117] "RemoveContainer" containerID="8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4" Jul 07 16:07:57.916148 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:07:57.916130 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4\": container with ID starting with 8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4 not found: ID does not exist" containerID="8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4" Jul 07 16:07:57.916246 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.916155 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4"} err="failed to get container status \"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4\": rpc error: code = NotFound desc = could not find container \"8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4\": container with ID starting with 8f293645abce341c32a1b96f8f300b3d0dadddb579c6bc9df3366e82035d2eb4 not found: ID does not exist" Jul 07 16:07:57.930167 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.930135 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:57.935308 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:57.935285 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f839a472-openshift-default-69766f9479-vw96k"] Jul 07 16:07:58.420011 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:58.419979 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b76af251-74cc-42c0-9b0f-0dba52484f0f" path="/var/lib/kubelet/pods/b76af251-74cc-42c0-9b0f-0dba52484f0f/volumes" Jul 07 16:07:59.435757 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:07:59.435729 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:00.696520 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:00.696491 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:01.729267 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:01.729241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.544789 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:08.544756 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.647413 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:08.647376 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.810964 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:08.810932 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:08.934893 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:08.934861 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:09.377137 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:09.377103 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:33.680671 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:33.680628 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:35.383108 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:35.383078 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:43.010320 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:43.010290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:43.147974 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:43.147934 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:43.315259 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:43.315222 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:43.468987 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:43.468952 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:08:59.434450 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:08:59.434367 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:06.097677 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:06.097642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:06.171675 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:06.171645 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:06.248339 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:06.248305 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:16.908009 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:16.907975 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:17.775740 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:17.775697 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:24.550008 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:24.549971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:24.654898 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:24.654867 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:24.751186 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:24.751155 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:24.851530 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:24.851437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:25.693852 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:25.693818 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:25.805994 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:25.805964 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:25.908966 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:25.908935 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:27.663450 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:27.663415 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:34.317653 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:34.317613 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:34.419584 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:34.419551 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:35.042038 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:35.042010 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:41.592369 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:41.592313 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:41.683979 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:41.683944 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:41.883893 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:41.883813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:42.222866 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:42.222781 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:42.321609 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:42.321580 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:45.169084 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:45.169046 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:45.289677 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:45.289643 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:45.470161 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:45.470080 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:45.930120 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:45.930089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:46.028755 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:46.028715 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:49.687116 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:49.687088 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.434859 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:50.434831 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.533939 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:50.533912 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:50.877231 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:50.877169 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:57.098998 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:57.098949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:57.197499 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:57.197468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:57.672065 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:57.672026 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:58.064480 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:58.064448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:09:58.171073 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:09:58.171022 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.085049 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.085002 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.360125 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.360018 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.452566 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.452533 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.652456 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.652377 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.776899 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.776864 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:05.871194 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:05.871164 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:06.008373 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:06.008275 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:06.883400 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:06.883366 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:06.983386 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:06.983348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:12.827421 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:12.827388 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:12.936085 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:12.936050 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:13.116828 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:13.116748 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:19.584818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:19.584780 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:19.684774 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:19.684722 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:26.393669 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:26.393620 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:26.491937 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:26.491892 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:26.624606 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:26.624565 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:26.968337 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:26.968299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:27.462712 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:27.462680 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:30.336150 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:30.336040 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:30.435113 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:30.435078 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:30.623044 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:30.622954 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:30.718961 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:30.718929 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:31.272529 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:31.272493 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:31.373487 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:31.373448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:34.878618 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:34.878582 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:10:38.383394 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:10:38.383360 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:12.572314 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:12.572284 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:12.993145 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:12.993055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:13.211930 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:13.211900 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:13.290698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:13.290607 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:18.707585 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:18.707546 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:11:23.805158 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:11:23.805116 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:00.146628 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:00.146544 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:01.919868 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:01.919825 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:08.404626 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:08.404593 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:12:08.408729 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:08.408706 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:12:08.633093 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:08.633061 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:08.732648 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:08.732570 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:08.946136 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:08.946101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:09.189906 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:09.189871 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:10.272265 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:10.272230 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:10.360961 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:10.360932 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:10.463122 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:10.463091 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:11.318338 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:11.318300 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:11.419166 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:11.419122 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:11.518548 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:11.518512 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:12.926492 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:12.926445 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:19.564330 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:19.564289 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:19.643408 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:19.643378 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:20.276632 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:20.276597 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:26.655990 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:26.655961 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:26.780676 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:26.780642 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:26.873012 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:26.872971 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:37.402280 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:37.402243 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:37.774887 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:37.774797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:12:58.795929 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:12:58.795895 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:05.731584 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:05.731539 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:06.966523 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:06.966485 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.107037 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:09.106981 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.206216 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:09.206172 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.445051 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:09.444970 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.552060 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:09.552028 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:09.985458 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:09.985423 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:10.081394 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:10.081343 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:13.635409 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:13.635373 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:14.014534 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:14.014444 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:14.339544 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:14.339511 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:14.612045 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:14.611966 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:17.182056 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.182007 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:17.275129 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.275097 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:13:17.275935 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.275903 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76af251-74cc-42c0-9b0f-0dba52484f0f" containerName="istio-proxy" Jul 07 16:13:17.275935 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.275935 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76af251-74cc-42c0-9b0f-0dba52484f0f" containerName="istio-proxy" Jul 07 16:13:17.276138 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.276030 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76af251-74cc-42c0-9b0f-0dba52484f0f" containerName="istio-proxy" Jul 07 16:13:17.279494 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.279474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.283807 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.283783 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-eb74cf-serving-cert\"" Jul 07 16:13:17.283942 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.283916 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5vqnq\"" Jul 07 16:13:17.296539 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.296398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:17.297298 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.297272 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:13:17.355684 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.355651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6qhk\" (UniqueName: \"kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.355879 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.355719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.355879 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.355803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.391737 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.391704 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:17.457111 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.457014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6qhk\" (UniqueName: \"kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.457111 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.457091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.457404 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.457172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.457807 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.457781 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.459654 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.459633 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.471881 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.471859 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6qhk\" (UniqueName: \"kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk\") pod \"maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.546542 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.546512 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:17.593441 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.593404 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:17.763326 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.763244 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:13:17.766498 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:13:17.766404 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8927fb70_15af_4674_a7b8_c9cfa4289206.slice/crio-14452ec225a83c079f17841fdf35770ab2242b8e7a12d99632fd3257af5454ed WatchSource:0}: Error finding container 14452ec225a83c079f17841fdf35770ab2242b8e7a12d99632fd3257af5454ed: Status 404 returned error can't find the container with id 14452ec225a83c079f17841fdf35770ab2242b8e7a12d99632fd3257af5454ed Jul 07 16:13:17.768169 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:17.768147 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:13:18.046657 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.046621 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:18.139637 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.139603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:18.502179 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.502085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" event={"ID":"8927fb70-15af-4674-a7b8-c9cfa4289206","Type":"ContainerStarted","Data":"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8"} Jul 07 16:13:18.502179 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.502140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" event={"ID":"8927fb70-15af-4674-a7b8-c9cfa4289206","Type":"ContainerStarted","Data":"14452ec225a83c079f17841fdf35770ab2242b8e7a12d99632fd3257af5454ed"} Jul 07 16:13:18.502623 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.502183 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:18.522072 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:18.522021 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" podStartSLOduration=1.122387248 podStartE2EDuration="1.522005926s" totalImagesPullingTime="399.618678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:13:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:18.519481129 +0000 UTC m=+1870.672259089" watchObservedRunningTime="2026-07-07 16:13:18.522005926 +0000 UTC m=+1870.674783888" Jul 07 16:13:21.653099 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:21.653065 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:24.512940 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:24.512911 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:13:26.787235 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:26.787189 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.846431 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:30.846351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:30.942133 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:30.942097 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:40.036946 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:40.036894 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:40.130927 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:40.130887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:47.156751 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:47.156716 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:13:50.007662 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:13:50.007633 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:04.858388 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:04.858355 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:05.798030 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:05.797993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:05.973801 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:05.973760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:06.380384 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:06.380347 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:06.481375 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:06.481340 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:06.582067 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:06.582034 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:06.799002 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:06.798970 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:11.445519 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:11.445484 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:48.909362 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:48.909323 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:49.194452 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:49.194359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:49.433459 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:49.433421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:49.623266 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:49.623201 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:50.023820 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.023735 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:50.120061 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.120028 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:50.220633 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.220603 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:50.373537 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.373366 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:14:50.373892 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.373850 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" podUID="8927fb70-15af-4674-a7b8-c9cfa4289206" containerName="maas-api" containerID="cri-o://f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8" gracePeriod=30 Jul 07 16:14:50.402654 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.402620 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:50.822998 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.822972 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:14:50.960059 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.959967 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls\") pod \"8927fb70-15af-4674-a7b8-c9cfa4289206\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " Jul 07 16:14:50.960059 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.960020 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca\") pod \"8927fb70-15af-4674-a7b8-c9cfa4289206\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " Jul 07 16:14:50.960326 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.960064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6qhk\" (UniqueName: \"kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk\") pod \"8927fb70-15af-4674-a7b8-c9cfa4289206\" (UID: \"8927fb70-15af-4674-a7b8-c9cfa4289206\") " Jul 07 16:14:50.960447 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.960420 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8927fb70-15af-4674-a7b8-c9cfa4289206" (UID: "8927fb70-15af-4674-a7b8-c9cfa4289206"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:14:50.962326 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.962294 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk" (OuterVolumeSpecName: "kube-api-access-d6qhk") pod "8927fb70-15af-4674-a7b8-c9cfa4289206" (UID: "8927fb70-15af-4674-a7b8-c9cfa4289206"). InnerVolumeSpecName "kube-api-access-d6qhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:14:50.962326 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.962310 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8927fb70-15af-4674-a7b8-c9cfa4289206" (UID: "8927fb70-15af-4674-a7b8-c9cfa4289206"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:14:50.965248 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.965223 2556 generic.go:356] "Generic (PLEG): container finished" podID="8927fb70-15af-4674-a7b8-c9cfa4289206" containerID="f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8" exitCode=0 Jul 07 16:14:50.965248 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.965239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" event={"ID":"8927fb70-15af-4674-a7b8-c9cfa4289206","Type":"ContainerDied","Data":"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8"} Jul 07 16:14:50.965392 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.965258 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" Jul 07 16:14:50.965392 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.965295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv" event={"ID":"8927fb70-15af-4674-a7b8-c9cfa4289206","Type":"ContainerDied","Data":"14452ec225a83c079f17841fdf35770ab2242b8e7a12d99632fd3257af5454ed"} Jul 07 16:14:50.965392 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.965321 2556 scope.go:117] "RemoveContainer" containerID="f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8" Jul 07 16:14:50.975839 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.975819 2556 scope.go:117] "RemoveContainer" containerID="f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8" Jul 07 16:14:50.976186 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:14:50.976159 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8\": container with ID starting with f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8 not found: ID does not exist" containerID="f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8" Jul 07 16:14:50.976295 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.976197 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8"} err="failed to get container status \"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8\": rpc error: code = NotFound desc = could not find container \"f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8\": container with ID starting with f42661ded96e7a53bb1210fac9010e03d1fffbb33592ec8b564350abddc78ad8 not found: ID does not exist" Jul 07 16:14:50.988173 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.988153 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:14:50.990645 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:50.990622 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-eb74cf-566bfd7498-svjbv"] Jul 07 16:14:51.061165 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:51.061133 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8927fb70-15af-4674-a7b8-c9cfa4289206-maas-api-tls\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:14:51.061165 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:51.061160 2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8927fb70-15af-4674-a7b8-c9cfa4289206-openshift-service-ca\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:14:51.061165 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:51.061171 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6qhk\" (UniqueName: \"kubernetes.io/projected/8927fb70-15af-4674-a7b8-c9cfa4289206-kube-api-access-d6qhk\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:14:52.420792 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:52.420759 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8927fb70-15af-4674-a7b8-c9cfa4289206" path="/var/lib/kubelet/pods/8927fb70-15af-4674-a7b8-c9cfa4289206/volumes" Jul 07 16:14:56.751990 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:56.751956 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:56.833922 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:56.833888 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:57.028975 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:57.028885 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:57.284412 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:57.284322 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:57.638461 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:57.638429 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:57.983154 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:57.983064 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:14:58.654142 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:14:58.654102 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:00.678571 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.678469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:00.743041 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.743005 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:00.743696 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.743670 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8927fb70-15af-4674-a7b8-c9cfa4289206" containerName="maas-api" Jul 07 16:15:00.743696 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.743696 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8927fb70-15af-4674-a7b8-c9cfa4289206" containerName="maas-api" Jul 07 16:15:00.743904 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.743798 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8927fb70-15af-4674-a7b8-c9cfa4289206" containerName="maas-api" Jul 07 16:15:00.748538 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.748517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.751025 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.750999 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5vqnq\"" Jul 07 16:15:00.751152 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.751010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-4c489a-serving-cert\"" Jul 07 16:15:00.761470 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.761441 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:00.778530 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.778495 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:00.854038 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.854003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmgt\" (UniqueName: \"kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.854249 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.854102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.854249 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.854172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.882440 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.882409 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:00.955432 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.955352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.955592 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.955465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmgt\" (UniqueName: \"kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.955592 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.955494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.955592 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:15:00.955494 2556 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-4c489a-serving-cert: secret "maas-api-e2e-api-a-4c489a-serving-cert" not found Jul 07 16:15:00.955735 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:15:00.955603 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls podName:0a872099-54f7-4935-acd5-e9d3e0372488 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:01.455579242 +0000 UTC m=+1973.608357184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls") pod "maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" (UID: "0a872099-54f7-4935-acd5-e9d3e0372488") : secret "maas-api-e2e-api-a-4c489a-serving-cert" not found Jul 07 16:15:00.956150 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.956128 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:00.965128 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:00.965109 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmgt\" (UniqueName: \"kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:01.148834 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.148801 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:01.438089 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.438054 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:01.460078 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.460049 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:01.462499 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.462473 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") pod \"maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:01.594917 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.594868 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:01.661069 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.661032 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:01.819183 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:01.819156 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:01.821064 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:15:01.821036 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a872099_54f7_4935_acd5_e9d3e0372488.slice/crio-f09d299095494d51537753ba244972c1f95873e2c9ce5924b28325275cdae0ad WatchSource:0}: Error finding container f09d299095494d51537753ba244972c1f95873e2c9ce5924b28325275cdae0ad: Status 404 returned error can't find the container with id f09d299095494d51537753ba244972c1f95873e2c9ce5924b28325275cdae0ad Jul 07 16:15:02.030357 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:02.030281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" event={"ID":"0a872099-54f7-4935-acd5-e9d3e0372488","Type":"ContainerStarted","Data":"f09d299095494d51537753ba244972c1f95873e2c9ce5924b28325275cdae0ad"} Jul 07 16:15:03.037266 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:03.037227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" event={"ID":"0a872099-54f7-4935-acd5-e9d3e0372488","Type":"ContainerStarted","Data":"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da"} Jul 07 16:15:03.037684 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:03.037340 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:03.066184 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:03.066127 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" podStartSLOduration=2.435313003 podStartE2EDuration="3.066112047s" totalImagesPullingTime="630.799044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:03.065173476 +0000 UTC m=+1975.217951444" watchObservedRunningTime="2026-07-07 16:15:03.066112047 +0000 UTC m=+1975.218890013" Jul 07 16:15:05.151472 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:05.151437 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:05.613683 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:05.613648 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:05.965803 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:05.965707 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:06.419855 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:06.419819 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:07.947032 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:07.946997 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:08.096911 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:08.096866 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:08.695918 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:08.695887 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:08.792146 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:08.792068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:08.886332 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:08.886298 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:09.048485 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:09.048452 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:09.444089 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:09.443993 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:09.544645 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:09.544612 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:09.746137 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:09.746053 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:13.213075 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:13.213039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:21.580369 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:21.580329 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:21.932534 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:21.932444 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:22.111932 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.111896 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:22.214659 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.214531 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:22.398310 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.398275 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:22.398505 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.398478 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" podUID="0a872099-54f7-4935-acd5-e9d3e0372488" containerName="maas-api" containerID="cri-o://02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da" gracePeriod=30 Jul 07 16:15:22.432081 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.432055 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:22.654765 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.654738 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:22.765558 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.765524 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") pod \"0a872099-54f7-4935-acd5-e9d3e0372488\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " Jul 07 16:15:22.765722 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.765574 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrmgt\" (UniqueName: \"kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt\") pod \"0a872099-54f7-4935-acd5-e9d3e0372488\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " Jul 07 16:15:22.765722 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.765599 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca\") pod \"0a872099-54f7-4935-acd5-e9d3e0372488\" (UID: \"0a872099-54f7-4935-acd5-e9d3e0372488\") " Jul 07 16:15:22.766031 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.766001 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a872099-54f7-4935-acd5-e9d3e0372488" (UID: "0a872099-54f7-4935-acd5-e9d3e0372488"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:15:22.767845 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.767785 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt" (OuterVolumeSpecName: "kube-api-access-lrmgt") pod "0a872099-54f7-4935-acd5-e9d3e0372488" (UID: "0a872099-54f7-4935-acd5-e9d3e0372488"). InnerVolumeSpecName "kube-api-access-lrmgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:15:22.767845 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.767799 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a872099-54f7-4935-acd5-e9d3e0372488" (UID: "0a872099-54f7-4935-acd5-e9d3e0372488"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:15:22.866410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.866372 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a872099-54f7-4935-acd5-e9d3e0372488-maas-api-tls\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:15:22.866410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.866403 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrmgt\" (UniqueName: \"kubernetes.io/projected/0a872099-54f7-4935-acd5-e9d3e0372488-kube-api-access-lrmgt\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:15:22.866410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:22.866418 2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a872099-54f7-4935-acd5-e9d3e0372488-openshift-service-ca\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:15:23.135724 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.135689 2556 generic.go:356] "Generic (PLEG): container finished" podID="0a872099-54f7-4935-acd5-e9d3e0372488" containerID="02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da" exitCode=0 Jul 07 16:15:23.135908 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.135732 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" Jul 07 16:15:23.135908 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.135747 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" event={"ID":"0a872099-54f7-4935-acd5-e9d3e0372488","Type":"ContainerDied","Data":"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da"} Jul 07 16:15:23.135908 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.135788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz" event={"ID":"0a872099-54f7-4935-acd5-e9d3e0372488","Type":"ContainerDied","Data":"f09d299095494d51537753ba244972c1f95873e2c9ce5924b28325275cdae0ad"} Jul 07 16:15:23.135908 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.135821 2556 scope.go:117] "RemoveContainer" containerID="02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da" Jul 07 16:15:23.144844 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.144829 2556 scope.go:117] "RemoveContainer" containerID="02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da" Jul 07 16:15:23.145101 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:15:23.145083 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da\": container with ID starting with 02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da not found: ID does not exist" containerID="02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da" Jul 07 16:15:23.145172 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.145108 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da"} err="failed to get container status \"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da\": rpc error: code = NotFound desc = could not find container \"02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da\": container with ID starting with 02b88fe15de464d6e173aad69738769312091da810c250069c3c500094d504da not found: ID does not exist" Jul 07 16:15:23.160052 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.160031 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:23.165821 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:23.165799 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4c489a-d84bd9f98-csdnz"] Jul 07 16:15:24.420837 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:24.420801 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a872099-54f7-4935-acd5-e9d3e0372488" path="/var/lib/kubelet/pods/0a872099-54f7-4935-acd5-e9d3e0372488/volumes" Jul 07 16:15:29.162410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:29.162370 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:29.283169 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:29.283129 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:29.448703 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:29.448615 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:29.657699 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:29.657662 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:29.827313 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:29.827277 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:30.199443 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:30.199360 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:30.299917 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:30.299884 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:30.402026 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:30.401989 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:30.583755 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:30.583723 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:36.944228 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:36.944173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:37.039465 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:37.039424 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:37.234002 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:37.233922 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:37.447301 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:37.447268 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:37.837942 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:37.837914 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:38.155579 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:38.155496 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:38.491410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:38.491325 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:40.896936 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:40.896894 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:40.987599 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:40.987567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:41.067670 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:41.067635 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:41.219295 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:41.219180 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:41.604895 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:41.604862 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:41.718959 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:41.718928 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:45.400005 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:45.399974 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:45.749592 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:45.749507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:46.106086 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:46.106056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:46.237912 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:46.237881 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.016248 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.016188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.097605 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.097573 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:15:49.097968 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.097955 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a872099-54f7-4935-acd5-e9d3e0372488" containerName="maas-api" Jul 07 16:15:49.098012 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.097969 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a872099-54f7-4935-acd5-e9d3e0372488" containerName="maas-api" Jul 07 16:15:49.098087 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.098075 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a872099-54f7-4935-acd5-e9d3e0372488" containerName="maas-api" Jul 07 16:15:49.101613 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.101590 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.103896 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.103871 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5vqnq\"" Jul 07 16:15:49.104039 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.103934 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-132358-serving-cert\"" Jul 07 16:15:49.112860 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.112408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.112860 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.112589 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:15:49.209366 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.209336 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.226120 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.226091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.226390 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.226243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj7z6\" (UniqueName: \"kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.226390 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.226326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.311699 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.311671 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.327730 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.327700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj7z6\" (UniqueName: \"kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.327878 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.327747 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.327878 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.327807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.328486 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.328464 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.330340 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.330317 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.336430 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.336407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj7z6\" (UniqueName: \"kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6\") pod \"maas-api-e2e-shared-b-132358-68577b8b57-7rvll\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.415035 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.415000 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:49.558708 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.558673 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:15:49.560447 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:15:49.560420 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8adb4b_092a_4bc4_9568_1567a84f4ba6.slice/crio-da0c8aa04ad8e8fbde31907b214f46ab8e14d39099a91852a7c8f57edd11e8e2 WatchSource:0}: Error finding container da0c8aa04ad8e8fbde31907b214f46ab8e14d39099a91852a7c8f57edd11e8e2: Status 404 returned error can't find the container with id da0c8aa04ad8e8fbde31907b214f46ab8e14d39099a91852a7c8f57edd11e8e2 Jul 07 16:15:49.755845 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.755797 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:49.858406 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:49.858311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:50.270657 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:50.270569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" event={"ID":"ad8adb4b-092a-4bc4-9568-1567a84f4ba6","Type":"ContainerStarted","Data":"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e"} Jul 07 16:15:50.270657 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:50.270622 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" event={"ID":"ad8adb4b-092a-4bc4-9568-1567a84f4ba6","Type":"ContainerStarted","Data":"da0c8aa04ad8e8fbde31907b214f46ab8e14d39099a91852a7c8f57edd11e8e2"} Jul 07 16:15:50.271071 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:50.270724 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:50.290974 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:50.290913 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" podStartSLOduration=0.908025037 podStartE2EDuration="1.29089004s" totalImagesPullingTime="382.865003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:50.290297101 +0000 UTC m=+2022.443075063" watchObservedRunningTime="2026-07-07 16:15:50.29089004 +0000 UTC m=+2022.443668009" Jul 07 16:15:53.559307 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:53.559270 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:15:56.282727 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:56.282695 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:15:58.892039 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:15:58.891999 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:02.600783 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:02.600741 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:02.706089 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:02.706056 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:12.032378 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:12.032344 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:12.132480 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:12.132444 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:23.212389 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:23.212358 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:41.559625 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:41.559532 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:16:41.748974 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:16:41.748939 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:17:08.434026 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:17:08.433998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:17:08.440820 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:17:08.440796 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:17:17.489506 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:17:17.489465 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:21.496973 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:21.496883 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:22.609302 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:22.609263 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:26.778055 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:26.778018 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:26.845090 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:26.845049 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:28.789829 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:28.789778 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:18:59.474137 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:18:59.474101 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:04.667503 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:19:04.667462 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:41.885867 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:19:41.885824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:19:42.857035 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:19:42.856994 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:07.457487 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:07.457454 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:08.903556 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:08.903521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:09.003919 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:09.003886 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:09.176306 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:09.176199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:27.145290 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:27.145236 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:20:33.894384 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:20:33.894351 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:03.592492 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:03.592398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:03.682737 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:03.682697 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:10.288491 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:10.288458 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:11.177586 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:11.177556 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:12.330997 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:12.330963 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:12.723163 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:12.723076 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:13.289785 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:13.289747 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:13.390037 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:13.390003 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:13.584670 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:13.584633 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:17.903539 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:17.903500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:56.288455 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:56.288418 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:56.652965 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:56.652932 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:56.886281 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:56.886245 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:57.104166 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.104128 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:57.490816 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.490714 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:57.628395 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.628356 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:21:57.628595 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.628573 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" podUID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" containerName="maas-api" containerID="cri-o://2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e" gracePeriod=30 Jul 07 16:21:57.673640 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.673611 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:21:57.880372 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.880344 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:21:57.961436 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.961394 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj7z6\" (UniqueName: \"kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6\") pod \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " Jul 07 16:21:57.961436 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.961435 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca\") pod \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " Jul 07 16:21:57.961653 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.961499 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls\") pod \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\" (UID: \"ad8adb4b-092a-4bc4-9568-1567a84f4ba6\") " Jul 07 16:21:57.961818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.961789 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad8adb4b-092a-4bc4-9568-1567a84f4ba6" (UID: "ad8adb4b-092a-4bc4-9568-1567a84f4ba6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:21:57.963559 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.963533 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6" (OuterVolumeSpecName: "kube-api-access-pj7z6") pod "ad8adb4b-092a-4bc4-9568-1567a84f4ba6" (UID: "ad8adb4b-092a-4bc4-9568-1567a84f4ba6"). InnerVolumeSpecName "kube-api-access-pj7z6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:21:57.963559 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:57.963545 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad8adb4b-092a-4bc4-9568-1567a84f4ba6" (UID: "ad8adb4b-092a-4bc4-9568-1567a84f4ba6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:21:58.063102 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.063072 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj7z6\" (UniqueName: \"kubernetes.io/projected/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-kube-api-access-pj7z6\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:21:58.063318 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.063108 2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-openshift-service-ca\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:21:58.063318 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.063125 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad8adb4b-092a-4bc4-9568-1567a84f4ba6-maas-api-tls\") on node \"ip-10-0-132-99.ec2.internal\" DevicePath \"\"" Jul 07 16:21:58.116528 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.116492 2556 generic.go:356] "Generic (PLEG): container finished" podID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" containerID="2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e" exitCode=0 Jul 07 16:21:58.116698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.116542 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" Jul 07 16:21:58.116698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.116557 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" event={"ID":"ad8adb4b-092a-4bc4-9568-1567a84f4ba6","Type":"ContainerDied","Data":"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e"} Jul 07 16:21:58.116698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.116600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll" event={"ID":"ad8adb4b-092a-4bc4-9568-1567a84f4ba6","Type":"ContainerDied","Data":"da0c8aa04ad8e8fbde31907b214f46ab8e14d39099a91852a7c8f57edd11e8e2"} Jul 07 16:21:58.116698 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.116620 2556 scope.go:117] "RemoveContainer" containerID="2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e" Jul 07 16:21:58.125641 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.125621 2556 scope.go:117] "RemoveContainer" containerID="2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e" Jul 07 16:21:58.125914 ip-10-0-132-99 kubenswrapper[2556]: E0707 16:21:58.125895 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e\": container with ID starting with 2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e not found: ID does not exist" containerID="2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e" Jul 07 16:21:58.125959 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.125921 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e"} err="failed to get container status \"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e\": rpc error: code = NotFound desc = could not find container \"2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e\": container with ID starting with 2cd21724f193672cebd5006073477f10808c11d189e5a5f1e873a1b15876dc5e not found: ID does not exist" Jul 07 16:21:58.139422 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.139401 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:21:58.149109 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.149086 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-132358-68577b8b57-7rvll"] Jul 07 16:21:58.419428 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:21:58.419353 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" path="/var/lib/kubelet/pods/ad8adb4b-092a-4bc4-9568-1567a84f4ba6/volumes" Jul 07 16:22:04.248607 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:04.248569 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:04.351499 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:04.351468 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:04.562873 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:04.562837 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:04.754884 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:04.754846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:05.155680 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:05.155636 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c849d55cd-52jm9_ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8/authorino/0.log" Jul 07 16:22:08.463171 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:08.463140 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:22:08.470424 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:08.470401 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-brcfh_0b766e02-00ff-4f29-a1cd-08a835c4a99f/ovn-acl-logging/0.log" Jul 07 16:22:09.986155 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:09.986128 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4rqjs_ec077b5a-fba1-45a9-bb24-f07f062e3867/manager/0.log" Jul 07 16:22:10.112394 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:10.112364 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nq9rq_86d0b574-25e3-4709-a6e6-3737aeace71d/manager/0.log" Jul 07 16:22:10.240859 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:10.240780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7446dd9f78-rr9g6_0af38e77-fb9c-46fa-9717-5604d30a7d3f/maas-api/0.log" Jul 07 16:22:10.639734 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:10.639709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b74d8f87b-lmf8c_0b528170-8977-4d17-ab40-36d677331309/manager/0.log" Jul 07 16:22:10.762059 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:10.762031 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ldgk6_f69728ff-95a7-4160-99df-20f8715f8e84/server/0.log" Jul 07 16:22:10.887222 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:10.887176 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xg7wk_ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08/manager/0.log" Jul 07 16:22:11.014372 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:11.014291 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-dzwnt_ec0005d4-0504-4eee-b540-a8a6af86ba9f/copy-manifests/0.log" Jul 07 16:22:11.030191 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:11.030167 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-dzwnt_ec0005d4-0504-4eee-b540-a8a6af86ba9f/manager/0.log" Jul 07 16:22:11.445248 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:11.445196 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mjbm2_071af4ee-328e-4e73-a8a3-42a5fa6c6d88/postgres/0.log" Jul 07 16:22:12.848738 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:12.848706 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c849d55cd-52jm9_ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8/authorino/0.log" Jul 07 16:22:13.097857 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:13.097828 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-24w9b_b605df2b-92d8-42b4-a2d4-6347bfa21e59/manager/0.log" Jul 07 16:22:13.214483 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:13.214404 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-l4bzf_8402f8c8-68b2-4df8-8b2b-e0125e38a1d8/kuadrant-console-plugin/0.log" Jul 07 16:22:13.338815 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:13.338782 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sgrkt_49b6ff20-dcf4-4b85-9e49-466d6583ee88/registry-server/0.log" Jul 07 16:22:13.475824 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:13.475738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xc76m_ef5dce55-e068-49d1-b6a7-5b51726d7551/manager/0.log" Jul 07 16:22:14.098943 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.098914 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rl2jx_51137311-0e69-4be3-9adc-512bcf66850c/istio-proxy/0.log" Jul 07 16:22:14.350040 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.349959 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-6b46w_52d8c119-23d1-401d-aa47-658eb6ccafbb/kube-auth-proxy/0.log" Jul 07 16:22:14.594345 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.594320 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/1.log" Jul 07 16:22:14.712905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.712825 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wdtdx_5192747a-dade-4419-9409-470383b39b37/payload-pre-processing/0.log" Jul 07 16:22:14.832752 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.832715 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-hn2wf_cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06/payload-processing/0.log" Jul 07 16:22:14.951890 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:14.951859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c566b8fdc-9tl98_9aff63dd-13e8-4627-b62f-ada8a4b0fe2f/router/0.log" Jul 07 16:22:15.540597 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:15.540569 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rtw6b_fc0afbe5-ea2b-4904-b6df-275b5f7cc9df/main/0.log" Jul 07 16:22:15.660685 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:15.660661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db26kgr_b88f382b-a72e-45d6-b1a5-4c36b033195b/main/0.log" Jul 07 16:22:15.774937 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:15.774909 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qrp7r_9f1ebd5b-75a1-4d3b-88cd-bac825d386ee/main/0.log" Jul 07 16:22:15.889014 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:15.888984 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-c65t6_394348b3-0798-4db4-bf64-b7f8de6a5bf0/main/0.log" Jul 07 16:22:20.532720 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:20.532690 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:20.682404 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:20.682367 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" limit=1024 Jul 07 16:22:23.629185 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:23.629152 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vbvnq_487e2f38-5580-4e12-b413-a483cba73d9d/global-pull-secret-syncer/0.log" Jul 07 16:22:23.715811 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:23.715784 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m7dsb_e6cf5239-4894-481d-94fe-2c5f15649696/konnectivity-agent/0.log" Jul 07 16:22:23.938270 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:23.938184 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-99.ec2.internal_c70a691a74463fa9618f16a94c763d4e/haproxy/0.log" Jul 07 16:22:29.236050 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:29.236018 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c849d55cd-52jm9_ad3125a2-cdd6-4653-bb7e-f387a5c6e0c8/authorino/0.log" Jul 07 16:22:29.327352 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:29.327326 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-24w9b_b605df2b-92d8-42b4-a2d4-6347bfa21e59/manager/0.log" Jul 07 16:22:29.365527 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:29.365501 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-l4bzf_8402f8c8-68b2-4df8-8b2b-e0125e38a1d8/kuadrant-console-plugin/0.log" Jul 07 16:22:29.420730 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:29.420661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sgrkt_49b6ff20-dcf4-4b85-9e49-466d6583ee88/registry-server/0.log" Jul 07 16:22:29.577079 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:29.577037 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xc76m_ef5dce55-e068-49d1-b6a7-5b51726d7551/manager/0.log" Jul 07 16:22:32.067676 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.067645 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbcw2_31436b55-2f8f-41f2-b299-509002fdfa78/node-exporter/0.log" Jul 07 16:22:32.093600 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.093571 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbcw2_31436b55-2f8f-41f2-b299-509002fdfa78/kube-rbac-proxy/0.log" Jul 07 16:22:32.130947 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.130922 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbcw2_31436b55-2f8f-41f2-b299-509002fdfa78/init-textfile/0.log" Jul 07 16:22:32.937338 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.937306 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2"] Jul 07 16:22:32.937700 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.937687 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" containerName="maas-api" Jul 07 16:22:32.937744 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.937702 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" containerName="maas-api" Jul 07 16:22:32.937778 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.937763 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad8adb4b-092a-4bc4-9568-1567a84f4ba6" containerName="maas-api" Jul 07 16:22:32.941161 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.941140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:32.948540 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.948518 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdvqz\"/\"kube-root-ca.crt\"" Jul 07 16:22:32.949354 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.949332 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gdvqz\"/\"default-dockercfg-xkzkm\"" Jul 07 16:22:32.949455 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.949332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdvqz\"/\"openshift-service-ca.crt\"" Jul 07 16:22:32.955861 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:32.955837 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2"] Jul 07 16:22:33.008637 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.008601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-proc\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.008818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.008648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-sys\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.008818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.008673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-podres\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.008818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.008742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swcpq\" (UniqueName: \"kubernetes.io/projected/2714f79b-9c40-401d-825b-93215efae7ed-kube-api-access-swcpq\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.008818 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.008799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-lib-modules\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109498 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-proc\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-sys\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-podres\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swcpq\" (UniqueName: \"kubernetes.io/projected/2714f79b-9c40-401d-825b-93215efae7ed-kube-api-access-swcpq\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109585 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-proc\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-lib-modules\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109669 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-sys\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109683 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-podres\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.109905 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.109754 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2714f79b-9c40-401d-825b-93215efae7ed-lib-modules\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.121705 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.121675 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swcpq\" (UniqueName: \"kubernetes.io/projected/2714f79b-9c40-401d-825b-93215efae7ed-kube-api-access-swcpq\") pod \"perf-node-gather-daemonset-6c2s2\" (UID: \"2714f79b-9c40-401d-825b-93215efae7ed\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.251473 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.251377 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:33.388668 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:33.388642 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2"] Jul 07 16:22:33.390831 ip-10-0-132-99 kubenswrapper[2556]: W0707 16:22:33.390801 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2714f79b_9c40_401d_825b_93215efae7ed.slice/crio-eb9558423ceff7f580d44e55cd2e5fdc6c2e2886f029ab68ae96a401b4879ce8 WatchSource:0}: Error finding container eb9558423ceff7f580d44e55cd2e5fdc6c2e2886f029ab68ae96a401b4879ce8: Status 404 returned error can't find the container with id eb9558423ceff7f580d44e55cd2e5fdc6c2e2886f029ab68ae96a401b4879ce8 Jul 07 16:22:34.130949 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:34.130921 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-2ckmw_653d4bda-89b9-4731-b8ed-534f44d76477/networking-console-plugin/0.log" Jul 07 16:22:34.301950 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:34.301916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" event={"ID":"2714f79b-9c40-401d-825b-93215efae7ed","Type":"ContainerStarted","Data":"4984abe90b369566c10955dcb7a4fa302605c59caea4d0da4a736fad2d04f084"} Jul 07 16:22:34.302117 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:34.302009 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:34.302117 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:34.302034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" event={"ID":"2714f79b-9c40-401d-825b-93215efae7ed","Type":"ContainerStarted","Data":"eb9558423ceff7f580d44e55cd2e5fdc6c2e2886f029ab68ae96a401b4879ce8"} Jul 07 16:22:34.325538 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:34.325485 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" podStartSLOduration=2.325471704 podStartE2EDuration="2.325471704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:22:34.32373085 +0000 UTC m=+2426.476508814" watchObservedRunningTime="2026-07-07 16:22:34.325471704 +0000 UTC m=+2426.478249712" Jul 07 16:22:36.997068 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:36.997043 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dftgq_38f222b7-9025-438d-966c-da9d8c96df65/dns/0.log" Jul 07 16:22:37.026649 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:37.026618 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dftgq_38f222b7-9025-438d-966c-da9d8c96df65/kube-rbac-proxy/0.log" Jul 07 16:22:37.219978 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:37.219943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w6b4s_cfd7b670-a8ee-43c6-9d3a-eca3d6583735/dns-node-resolver/0.log" Jul 07 16:22:37.860991 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:37.860964 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69d9f686fb-dfqms_559cbf36-707a-4c15-b45a-f25eb50abe9a/registry/0.log" Jul 07 16:22:37.949784 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:37.949754 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzbf2_b8bb7b0d-83b3-4093-8134-aed3728db1b9/node-ca/0.log" Jul 07 16:22:38.990480 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:38.990450 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rl2jx_51137311-0e69-4be3-9adc-512bcf66850c/istio-proxy/0.log" Jul 07 16:22:39.127498 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.127470 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-6b46w_52d8c119-23d1-401d-aa47-658eb6ccafbb/kube-auth-proxy/0.log" Jul 07 16:22:39.197493 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.197464 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/0.log" Jul 07 16:22:39.225933 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.225899 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/1.log" Jul 07 16:22:39.266150 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.266058 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wdtdx_5192747a-dade-4419-9409-470383b39b37/payload-pre-processing/0.log" Jul 07 16:22:39.324729 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.324687 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-hn2wf_cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06/payload-processing/0.log" Jul 07 16:22:39.372504 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:39.372478 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c566b8fdc-9tl98_9aff63dd-13e8-4627-b62f-ada8a4b0fe2f/router/0.log" Jul 07 16:22:40.132578 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.132551 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-22x8c_e9720587-0373-4cc8-be34-e27ab176c365/serve-healthcheck-canary/0.log" Jul 07 16:22:40.317525 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.317488 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6c2s2" Jul 07 16:22:40.740962 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.740929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jknpk_03c12a1b-429d-4566-a2eb-d15a4d96ee37/insights-operator/0.log" Jul 07 16:22:40.741309 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.741288 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jknpk_03c12a1b-429d-4566-a2eb-d15a4d96ee37/insights-operator/1.log" Jul 07 16:22:40.784826 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.784796 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcrvn_0baa3194-0cdd-4199-8cea-fe844cba9f43/kube-rbac-proxy/0.log" Jul 07 16:22:40.825774 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.825752 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcrvn_0baa3194-0cdd-4199-8cea-fe844cba9f43/exporter/0.log" Jul 07 16:22:40.867411 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:40.867381 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qcrvn_0baa3194-0cdd-4199-8cea-fe844cba9f43/extractor/0.log" Jul 07 16:22:43.467341 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.467133 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rl2jx_51137311-0e69-4be3-9adc-512bcf66850c/istio-proxy/0.log" Jul 07 16:22:43.523744 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.523711 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4rqjs_ec077b5a-fba1-45a9-bb24-f07f062e3867/manager/0.log" Jul 07 16:22:43.597539 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.597508 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-6b46w_52d8c119-23d1-401d-aa47-658eb6ccafbb/kube-auth-proxy/0.log" Jul 07 16:22:43.653604 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.653575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/0.log" Jul 07 16:22:43.677468 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.677439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nq9rq_86d0b574-25e3-4709-a6e6-3737aeace71d/manager/0.log" Jul 07 16:22:43.688966 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.688928 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/1.log" Jul 07 16:22:43.716631 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.716600 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wdtdx_5192747a-dade-4419-9409-470383b39b37/payload-pre-processing/0.log" Jul 07 16:22:43.721574 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.721516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7446dd9f78-rr9g6_0af38e77-fb9c-46fa-9717-5604d30a7d3f/maas-api/0.log" Jul 07 16:22:43.764400 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.764376 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-hn2wf_cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06/payload-processing/0.log" Jul 07 16:22:43.782188 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.782168 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c566b8fdc-9tl98_9aff63dd-13e8-4627-b62f-ada8a4b0fe2f/router/0.log" Jul 07 16:22:43.895532 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.895496 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b74d8f87b-lmf8c_0b528170-8977-4d17-ab40-36d677331309/manager/0.log" Jul 07 16:22:43.938731 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:43.938704 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ldgk6_f69728ff-95a7-4160-99df-20f8715f8e84/server/0.log" Jul 07 16:22:44.010049 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:44.009974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xg7wk_ec7ea4b9-5929-48fb-aef7-bb2d2ec5fd08/manager/0.log" Jul 07 16:22:44.087792 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:44.087750 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-dzwnt_ec0005d4-0504-4eee-b540-a8a6af86ba9f/manager/0.log" Jul 07 16:22:44.122469 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:44.122442 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-dzwnt_ec0005d4-0504-4eee-b540-a8a6af86ba9f/copy-manifests/0.log" Jul 07 16:22:44.308970 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:44.308945 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mjbm2_071af4ee-328e-4e73-a8a3-42a5fa6c6d88/postgres/0.log" Jul 07 16:22:44.989149 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:44.989125 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4rl2jx_51137311-0e69-4be3-9adc-512bcf66850c/istio-proxy/0.log" Jul 07 16:22:45.120516 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.120487 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-6b46w_52d8c119-23d1-401d-aa47-658eb6ccafbb/kube-auth-proxy/0.log" Jul 07 16:22:45.172410 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.172376 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/0.log" Jul 07 16:22:45.202496 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.202464 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-chxfh_68f3b63b-0673-4f30-9b33-a6ed2e34bd9a/istio-proxy/1.log" Jul 07 16:22:45.228620 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.228589 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wdtdx_5192747a-dade-4419-9409-470383b39b37/payload-pre-processing/0.log" Jul 07 16:22:45.269846 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.269769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-hn2wf_cc1c6ad0-dda1-45ba-bcfb-2a2fc0570a06/payload-processing/0.log" Jul 07 16:22:45.312253 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:45.312222 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c566b8fdc-9tl98_9aff63dd-13e8-4627-b62f-ada8a4b0fe2f/router/0.log" Jul 07 16:22:51.204876 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:51.204844 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cbgxt_dd4b8ac0-61ad-4035-b55a-128e5073a246/kube-storage-version-migrator-operator/1.log" Jul 07 16:22:51.205641 ip-10-0-132-99 kubenswrapper[2556]: I0707 16:22:51.205623 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-cbgxt_dd4b8ac0-61ad-4035-b55a-128e5073a246/kube-storage-version-migrator-operator/0.log"